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Abstract 



Information-theoretic arguments focus on modeling the rehabihty of information transmis- 
sion, assuming availabihty of infinite data at sources, thus ignoring randomness in message 
generation times at the respective sources. However, in information transport networks, not 
only is reliable transmission important, but also stability, i.e., finiteness of mean delay in- 
curred by messages from the time of generation to the time of successful reception. Usually, 
delay analysis is done separately using queueing-theoretic arguments, whereas reliable infor- 
mation transmission is studied using information theory. In this thesis, we investigate these 
two important aspects of data communication jointly by suitably combining models from 
these two fields. In particular, we model scheduled communication of messages , that ar- 
rive in a random process, (i) over multiaccess channels, with either independent decoding or 
joint decoding, and (ii) over degraded broadcast channels. The scheduhng policies proposed 
permit up to a certain maximum number of messages for simultaneous transmission. 

In the first part of the thesis, we develop a multi-class discrete-time processor-sharing 
queueing model, and then investigate the stability of this queue. In particular, we model 
the queue by a discrete-time Markov chain defined on a countable state space, and then 
establish (i) a sufficient condition for c-regularity of the chain, and hence positive recurrence 
and finiteness of stationary mean of the function c of the state, and (ii) a sufficient condition 
for transience of the chain. These stabihty results form the basis for the conclusions drawn 
in the thesis. 

The second part of the thesis is on multiaccess communication with random message 
arrivals. In the context of independent decoding, we assume that messages can be classified 
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into a fixed number of classes, eacli of wliicli specifies a combination of received signal 
power, message length, and target probability of decoding error. Each message is encoded 
independently and decoded independently. In the context of joint decoding, we assume that 
messages can be classified into a fixed number of classes, each of which specifies a message 
length, and for each of which there is a message queue. From each queue, some number of 
messages are encoded jointly, and received at a signal power corresponding to the queue. The 
messages are decoded jointly across all queues with a target probability of joint decoding 
error. 

For both independent decoding and joint decoding, we derive respective discrete- 
time multiclass processor-sharing queueing models assuming the corresponding information- 
theoretic models for the underlying communication process. Then, for both the decoding 
schemes, we (i) derive respective outer bounds to the stability region of message arrival 
rate vectors achievable by the class of stationary scheduling policies, (ii) show for any mes- 
sage arrival rate vector that satisfies the outer bound, that there exists a stationary "state- 
independent" policy that results in a stable system for the corresponding message arrival 
process, and (iii) show that the stability region of information arrival rate vectors, in the 
limit of large message lengths, equals an appropriate information-theoretic capacity region 
for independent decoding, and equals the information-theoretic capacity region for joint de- 
coding. For independent decoding, we identify a class of stationary scheduling policies, for 
which we show that the stability region in the limit of large maximum number of simultane- 
ous transmissions is independent of the received signal powers, and each of which achieves a 
spectral efficiency of 1 nat/s/Hz in the hmit of large message lengths. 

In the third and last part of the thesis, we show that the queueing model developed for 
multiaccess channels with joint decoding can be used to model communication over degraded 
broadcast channels, with superposition encoding and successive decoding across all queues. 
We then show respective results (i), (ii), and (iii), stated above. 
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Chapter 1 
Introduction 



Information-theoretic arguments focus on modeling the rehabihty of information transmis- 
sion, assuming availabihty of infinite data at sources, thus ignoring randomness in message 
generation times at the respective sources. However, in information transport networks, not 
only is reliable transmission important, but also stability, i.e., finiteness of mean delay in- 
curred by messages from the time of generation to the time of successful reception. Usually, 
delay analysis is done separately using queueing-theoretic arguments, whereas reliable infor- 
mation transmission is studied using information theory. In his seminal paper [2j published 
in 1985, Gallager explains: 

For the last ten years there have been at least three bodies of research on mul- 
tiaccess channels, each proceeding in virtual isolation from the others and each 
using totally different models. The objective here is to contrast these bodies of 
work and to give some perspective on what is needed to provide some unifica- 
tion between the areas. We shall refer to the three dbTQdbS clS collision resolution, 
multiaccess information theory, and spread spectrum. 

Then he goes on to say that ■ ■ • 



Collision resolution research has always focused on the bursty arrivals of messages 
and the interference between transmitters, but has generally ignored the noise. 
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More generally, this approach ignores the underlying communication process, 
assuming only that a message transmission is correctly received in the absence 
of collision and incorrectly received otherwise. 

• • • In this approach (multiaccess information theory) , the noise and interference 
aspects of the multiaccess channel are appropriately modeled, but the random 
arrivals of the messages are ignored. 

In this thesis, we investigate these two important aspects of data communication jointly by 
suitably combining models from these two fields. In particular, we model scheduled commu- 
nication of messages , that arrive in a random process, (i) over multiaccess channels, with 
either independent decoding or joint decoding, and (ii) over degraded broadcast channels. 
The scheduling policies proposed permit up to a certain maximum number of messages for 
simultaneous transmission. 

1.1 Problem Formulation 

The following three multiuser communication scenarios SI, S2, and S3, are investigated in 
the dissertation. 

(SI) There are J > 1 transmitting stations communicating to a central receiver. We assume 
that the transmitting stations and central receiver are time synchronized, and that 
there exists an error-free feedback channel over which the central receiver broadcasts 
pertinent control information to the transmitting stations. For 1 < j < J and integers 
Mj > 2, let messages of length InMj nats arrive at the jth station in a batch arrival 
process with i.i.d. batch sizes. The transmitter at the jth transmitting station is 
assigned an average transmit power Pj. At transmitting station j, there is a block 
encoder that jointly encodes at most Sj > 1 packets into a code word. The central 
receiver decodes the received word using joint maximum-likelihood decoding. It is 
required that the received word be decoded with an expected error probability of at 



most Pe- Then, we ask the question: for what message arrival rates at the respective 
transmitting stations is the message communication system stable, i.e., messages are 
decoded in finite mean time?. 

(52) There is a base station and potentially an unlimited number of terminals communicat- 
ing to the base station. We say that a terminal is active if it has a packet to transmit, 
otherwise the terminal is said to be inactive. Terminals become active at random 
times. We assume independent and identically distributed quasi-static fiat fades from 
the active terminals to the base station in the respective channels. With this assump- 
tion, there is an i.i.d. multiplicative gain in the channel from each terminal to the base 
station. Thus, for a given multiplicative gain 7, a message signal of average transmit 
power P will be received at the signal power I7P-P. We assume that the multiplicative 
gain 7 is known to the base station, and is a random variable that has J possible 
values for magnitude. Each message has to be decoded with expected error proba- 
bility at most Pe- Then, again we ask the question: at what rates can the terminals 
become active so that, when joint maximum-likelihood decoding is performed at the 
base station, messages are decoded in finite mean time. 

(53) There are J message sources co-located with a transmitter, and an equal number of 
receivers. Each source wishes to communicate information to its receiver such that the 
expected decoding error probability at the jth receiver is at most pej. The transmitter 
encodes messages from these sources using superposition encoding, and broadcasts the 
encoded signal over a degraded broadcast channel (DBC). At each receiver, the decoder 
maps its received signal into an estimate of the message intended for it. Messages are 
generated at random times at each source. Again we ask the question: at what rates 
can these sources communicate reliably and stably to their respective receivers. 

1.2 Summary of Related Work 

The first effort, in the direction pointed out by Gallager in his seminal work T], that the 
random generation of messages and the subsequent reliable information transmission must be 



understood in a unified framework, was reported in jTHj and ^3] ■ Tlie framework considered 
tfierein is as follows. Consider a multiaccess message communication system. Requests for 
message transmissions over a flat bandpass additive white Gaussian noise (AWGN) channel 
arrive according to a Poisson process. Messages, upon arrival, are given immediate access, 
i.e., each transmitter transmits its signal, starting at its message arrival time. Existence of an 
errorless, delayless, control channel in each direction is assumed. Upon noticing the presence 
of a message request, the receiver and the transmitter agree upon a Gaussian codebook with 
Gaussian codewords of zero mean, equal power P, and uniform power spectral density over 
a narrow frequency band of width W, following the random coding principle. Messages are 
selected from a finite message alphabet of size M. Each message has to be transmitted 
reliably with reliability quantified by the tolerable message decoding error probability, pe- 

Signal propagation delays in the system are assumed to be negligible. It is assumed 
that the receiver operates with full knowledge of the message alphabet sizes and received 
signal powers of all transmitters in the system. The receiver decodes the message of a 
transmitter by treating the signals from other transmitters as independent additive noise. 
This is the independent decoding assumption for decoding of a message at the receiver. The 
receiver uses the codebook of a transmitter in maximum likelihood decoding of the message 
of the transmitter. Each message transmits its signal for a random duration determined by 
the receiver. A stopping rule is used by the receiver to stop transmission of the signal for 
a message. The stopping rule ensures that the expected probability of error in decoding a 
message in the system is less than the tolerable value pe- 

In [1^, ^3] this random-coded multi-access system is then modelled as a continuous- 
time processor-sharing queue in which the transmitters are "customers" that are "served" 
by the receiver. The processor-sharing model is then analyzed to determine the stability 
condition and the mean delays experienced by the incoming messages, by determining steady- 
state probabilities. 



1.3 Modelling 



In this thesis, we first generahze the framework ^H] , ^B] that models both the random mes- 
sage arrivals and the subsequent rehable communication by suitably combining techniques 
from queueing theory and information theory. We then investigate message communication 
over (i) multiaccess channels with independent decoding and joint maximum-likelihood de- 
coding, and (ii) degraded broadcast channels, in that general framework. In the following, 
we point out the ways in which our model differs from the model in ^^1; QB]; and then 
summarize the contributions made in the thesis. 

1. Signal transmissions from different transmitters may be received at different signal 
powers at the receiver 

Unlike in the model [12], jlH], we allow independent and identically distributed 
quasi-static flat fades from the transmitters to the receiver in the respective chan- 
nels. With this assumption, there is an i.i.d. multiplicative gain in the channel 
from each transmitter to the receiver. Thus, for a given multiplicative gain 7, a 
message signal of average power P will be received at the signal power I7P-P. We 
assume that the multiplicative gain 7 is known to the receiver, and is modelled 
as a random variable that has a finite number of finite possible magnitudes. 

2. The receiver schedules message transmissions 

We assume that messages can be classified into a fixed number of classes each 
of which specifies a combination of received signal power, message length, and 
target probability of decoding error. The notion of message classes naturally 
leads to scheduling, i.e., the question of how many messages of each class are to 
be scheduled at a given time. Due to the complexity involved in joint maximum- 
likelihood decoding of an arbitrary number of messages, we restrict the receiver 
to schedule upto at most some finite number of messages at a time. Also, in 
the case of DBC, the complexity involved in joint superposition encoding of an 
arbitrary number of messages again leads us to the same restriction. Specifically, 



the scheduling pohcies proposed in this thesis permit up to a certain maximum 
number K > 1 of messages for simultaneous transmission. 

3. Decoding techniques 

In jT3], ^ni; independent maximum-likelihood decoding of signal transmissions 
is proposed. In independent decoding, a message signal is decoded treating all 
other signal transmissions, if any, as interference. Thus the effective noise is the 
sum of additive Gaussian noise plus other active signal transmissions present in 
the system. We should observe here that scheduling at most a finite number K of 
messages for simultaneous transmission has the effect of limiting the interference 
as seen by any message transmission, i.e., K — 1 transmissions can interfere. Since 
independent decoding is suboptimal, we also consider joint maximum- likelihood 
decoding of signal transmissions across all message classes with a common target 
probability of joint decoding error. Some previous work with joint decoding is 
reported in But, to our knowledge, the details of this work have not been 
published elsewhere. We beheve that the decoding technique proposed in [T3j is 
complicated for the following reason: to decode n active transmitters, one has to 
create (2" — 1) joint decoders, one for each non-empty subset of the set of active 
transmitters, and this number increases exponentially with n. With scheduling 
being made part of our model and with the restriction on the maximum number 
of simultaneous message transmissions, a message is decoded by only one joint 
decoder. 

In our model, the communication channel is a quasi-static flat bandpass AWGN 
channel of bandwidth W. Formally, y{t) = '~fx{t) + N{t), where the input x{t) is a band- 
limited zero-mean Gaussian process of bandwidth W and average power P, 7 is a finite 
valued real random variable, and N{t) is a white Gaussian noise process independent of 
the input x{t) with noise power spectral density The analysis of the model starts with 
first replacing this continuous-time model by an equivalent discrete-time model. This is 
done by first replacing the continuous-time model by an equivalent continuous-time complex 



low-pass model. In this model, the inputs and outputs are continuous-time complex low- 
pass signals of bandwidth and the channel is a low-pass filter of bandwidth Then 
using the sampling theorem for low-pass signals, we sample the input and output at the 
rate of W complex samples per second, or 2W real samples per second. Thus we reduce the 
continuous-time AWGN channel to a sequence of independent complex baseband channels 
i such that the model for the ith channel is yi = jXi + rii. The input Xi = (^x[^\xf^^^ 
is circular symmetric complex Gaussian random variable with the distribution CM (O, 
and noise rii = (^riY\n\^''^ is circular symmetric complex Gaussian random variable with the 
distribution CAf (O, In this thesis, we analyze communication over stationary discrete 
memoryless channel (DMC) with complex inputs and outputs. 



1.4 Contributions 

For multiaccess communication with independent decoding, we show the following. 

1. For finite message lengths, inner bounds and outer bounds to the message arrival 
rate stability region are derived. For arrival rates within the inner bounds, we show 
finiteness of the stationary mean for the number of messages in the system and hence for 
message delay. For the case of equal received signal powers, with sufficiently large SNR, 
the stability threshold increases with decreasing maximum number of simultaneous 
transmissions. 

When message lengths are large , the information arrival rate stability region has an 
interpretation in terms of interference-limited information-theoretic capacities. For 
the case of equal received powers, this stabihty threshold is the interference-limited 
information-theoretic capacity. 

We propose a class of stationary policies called state-independent scheduling policies, 
and then show that they achieve this asymptotic information arrival rate stability 
region. 



4. In the asymptotic limit corresponding to immediate access, the stabiUty region for non- 
idhng scheduUng poUcies is shown to be identical irrespective of received signal powers. 
This observation essentially shows that transmit power control is not needed. We show 
that, in the asymptotic limit corresponding to immediate access and large message 
lengths, a spectral efficiency of 1 nat/s/Hz is achievable with non-idling scheduling 
policies. 

For multiaccess communication with joint maximum- likelihood decoding and degraded broad- 
cast channels with joint superposition encoding and successive decoding, we show the fol- 
lowing. 

1. For scheduled message communication over (i) multiaccess channels with joint maximum- 
likelihood decoding, and (ii) degraded broadcast channel, we derive outerbounds to 
the respective stability region of message arrival rate vectors achievable by the class of 
stationary scheduling policies. Then we show for any message arrival rate vector that 
satisfies the outer bound, that there exists a stationary "state-independent" schedufing 
policy that results in a stable system for the corresponding message arrival processes. 

2. We show that the stabifity region of information arrival rate vectors for (i) multiaccess 
communication with joint maximum-likelihood decoding, and (ii) message communi- 
cation over degraded broadcast channels, with superposition encoding and successive 
decoding, are the information-theoretic capacity regions, respectively. For example, 
consider a rate vector r = (ri,r2) in the two- user multiaccess achievable rate region 
corresponding to an arbitrary product probability distribution Qi{xi)Q2{x2)- Then we 
show that there exists a scheduling strategy that tells us how many messages of what 
length from each information source must be scheduled together so that, when the jth 
source, j — 1,2, generates information at the rate rj information units/time unit, the 
corresponding message communication system is stable, i.e., messages are decoded in 
finite mean time. 



1.5 A Note to the Reader 



Chapter 121 can be read independent of everything else in this thesis. But the purposes of the 
model introduced and the results obtained in that chapter become apparent in subsequent 
chapters. Chapter El and Chapter HI can be read to a large extent independently. Except for 
Section 15. Chapter El should be read only after Chapter HI is read. 



Chapter 2 

A MultiClass Discrete-Time 
Processor-Sharing Queue 

In this chapter, we develop a multi-class discrete-time processor-sharing queueing model, and 
then investigate the stability of this queue. In particular, we model the queue by a discrete- 
time Markov chain defined on a countable state space, and then establish (i) a sufficient 
condition for c-regularity ^0] of the chain, and hence positive recurrence and finiteness of 
stationary mean of the function c of the state, and (ii) a sufficient condition for transience of 
the chain. These stability results form the basis for the conclusions drawn in the following 
chapters. 

2.1 The Queueing Model 

Consider a queueing system consisting of J queues operating in discrete-time. Time is divided 
into equal length time intervals called time-slots. Each queue is fed by an independent, 
stationary, batch arrival process with i.i.d. batch sizes for different time-slots. Let the 
random variable Aj represent the number of customers that arrive in any time-slot to the jth 
queue. Assume that the pmf Pr(y4j = k) = Pj{k), k > 0, has ffnite moments EAj and E^^. 
{Aj] I < j < J} are independent random variables. Let = (EAi, EA2, . . . , EAj) G M+ 
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be the vector of arrival rates of the arrival processes. 

We assume that a customer that arrives at the system has associated with it a class 
that gives sufficient information about the customer. A customer requires an amount of 
service and the service requirement is modeled as a constant quantity. Let Sj denote the 
service requirement of a class- j customer. When the cumulative service quantum that a 
customer has received equals or exceeds its service requirement, the customer leaves the 
system. To define the state of the system we keep track of the residual service requirement 
of each customer present in the system. We shall define by aj = (xj(l), Xj{2), . . . ,Xj {nj{a))) 
the state of queue j, where nj{a) denotes the number of class-j customers in state a and 
Xj{k) gives the residual service requirement of kth customer of class- j in state a, and by 

a = {ai,a2, . . . (2.1) 

the state of the system. Obviously, n{a) = J2j=i is the total number of customers in 

the system state a. 

Further, we assume that the server schedules certain numbers of customers of the 
various classes for providing simultaneous service in each time-slot using a preemptive resume 
scheduling policy. Wc define a schedule by a non-negative integer vector s = (si, S2, . . . , sj). 
For an integer K > 1, we define the set 5k = |s : < ^^^=1 Sj < k| to be the set of all 
schedules that schedule at most K customers in each time-slot. We say that schedule s is 
feasible in state a if Sj < nj{a), for j — 1,2, . . . , J. We implement a feasible schedule s by 
serving the first Sj customers at the head of queue-j, for 1 < j < J. A schedule s such that 
Sj = for 1 < J < J is called the empty schedule. 

In this thesis we consider only stationary scheduling policies. We define a stationary 
deterministic scheduling policy a; as a mapping {u : X ^ 5k} for which the schedule co^a) 
is feasible in state a for all a. For a stationary randomized policy uj, uj{a) is then a random 
variable taking values in Sk with some probability distribution {Pa{s)',s e Sk}- We note 
here that deterministic policies are special cases of randomized scheduling policies. 



Define 0j(>s) > to be the service quantum ^ that a class-j customer is eligible to 
receive under the schedule s. We allow for the possibility that the service quantum made 
available to a customer in a time-slot may be more than the residual service requirement of 
the customer, and in that case, the amount by which the offered service quantum is in excess 
of the customer residual requirement goes unused. Since Sj customers of class-j are provided 
service under the schedule s, a total service quantum upto Sj4>j{s) can be provided to class-j 
customers. But, this could be interpreted as being equivalent to completing service of up to 
^^^^ customers in a time-slot under the schedule s. Thus, for each s e 5k, we define a rate 
vector r{s) = (ri(s), r2(s), . . . ,rj(s)), in units of customers/time-slot, where rj{s) = ^^^M 
for 1 < j < J. 

Here we make the observation that the service quantum (f)j{s) made available to a 
class-j customer can vary with the schedule s, and also, the fraction of the total service 
quantum made available to class-j under the schedule s can vary over the set {1, 2, . . . , J} of 
customer classes. In other words, the server is modeled as a possibly non-uniform processor- 
sharing server. 

Let X be the countable set of all state vectors a. Countability of the state space X 
follows from the fact that the residual service requirement variable x for any customer class 
can take only finitely many values. Let {X„; n > 0} be a discrete-time Markov chain defined 
over the state space X with {p'^a'j '^j ^' ^ '^l ^ the state transition probability matrix under 
the scheduling policy uj. In each time-slot three events take place. Just after the beginning 
of a time-slot, first, the system state a is read, next the schedule a;(a) is implemented and 
finally, new arrivals, if any, are admitted into the system. 



2.2 Stability for the Underlying Markov Chain 

Let {X„; n > 0} be a positive recurrent discrete-time Markov chain defined on a countable 
state space X with stationary probability measure {iJ,{a);a e X}. Let c be a bounded 

^We use the convention that (t)j{s) = if Sj = 0. 



function on X. Then the ensemble average of c, E'^(c) = '^('^)/^('^)' exists and for every 
initial condition a ^ X, 



We can relax the boundedness assumption made on c and still have the ensemble average 
E'^(c) exist if the Markov chain under consideration is "c- regular" ^1] |inj . 

Definition 2.2.1 {c- Regularity) Let c : X [l,oo] be a function defined on the state 
space X . A set Y E X is called c-regular if, for each non-empty subset Y' G X , 



where Ty is the first passage time to the set Y' . The Markov-chain chain n > 0} itself 
is called c-regular if there is a countable cover of X with c-regular sets. 

A c-regular chain is positive recurrent and possesses an invariant probability measure 
fi satisfying E^(c) < oo. An approach to establish c-regularity for a Markov chain with 
transition probability matrix G X} is to (i) construct a Lyapunov function 

V : X ]R_|_, (ii) find a c function that is near-monotone^ i.e., {a E X : c(a) < 77} is finite 
for any r] < supQ,c(a), and (iii) find a constant J < sup^c(a) such that 



Then, under the above assumptions. Theorem 10.3 in piU guarantees that the Markov chain 
{Xn] n > 0} is c-regular. The notion of stability that we consider in this thesis, for a discrete- 
time Markov chain defined on a countable state space, and underlying the queueing model, 
is given in the following definition. 

Definition 2.2.2 We say that a discrete-time countable- state Markov chain {Xn',n > 0} 
under a stationary scheduling policy uj is (i) stable if it is positive recurrent and has finite 
stationary mean for the number of customers in the system, and (ii) unstable if it is transient. 



lim E„ [c = E^(c) 



n 




^V{a) ^ Y.V{a')pl^,-V{a)<-c{a) + S 



2.3 Sufficient Conditions for c- Regularity and Tran- 
sience for the Queueing Model 



2.3.1 A Sufficient Condition for c-Regularity 

In what follows in the present chapter and in subsequent chapters, we will need to consider 
non-negative real valued functions defined on the state space X that possess the prop- 
erty ESUl stated below. To state that property, we first fix a scheduling policy u. Let aj (a 
sample value for the random variable Aj) new customers arrive to the jth queue in any time- 
slot, and let a = (ai, 02, ... , aj) G In this thesis, we assume customer arrival processes 
in the future to be independent of the current state of the system. For each customer-class 
j, we assume the existence of a real- valued deterministic function : X ^ R+, defined on 
the state space X and with the following property: assume that aj class-j customers arrive 
in state a and that the feasible schedule s is implemented in the state a. As a result, assume 
that the chain moves to the state a'. Then h'j [a') can be written as 



where fj{a) and gj{a, s) are non- negative numbers. When this property holds we say that, as 
the chain makes the transition a —>■ a', h^{a) first decreases by gj{a, s), due to the delivery of 
service quantum, and then increases by fj (a) , due to new customer arrivals, thus increasing 
by the net amount fj{a) — gj{a, s). 

Property 2.3.1 Let : X ^ IR+. For a given stationary scheduling policy uj, customer 
arrival processes [Aj] 1 < j < J} , the function h'j satisfies 



where fj{a) > 0, and gj{a, s) > depends on the precise specification of the scheduling policy 




(2.2) 



/ij (a') = h'^ia) + fj{a) - gj{a, s 



Define = {p'^{s);a G X and s e iSk} to be a probability distribution on the set of schedules 
»Sk, and indexed by the state a. The interpretation for p%{s) is that the schedule s gets 
implemented in the state a with probability 

Further, we assume that, for each class-j, a partition ^7ij,7ij} of the state space X 
exists such that sup^g-^^. h'j{a) is finite. Define the following set of partitions: for 1 < j < J, 

= \ {nj,^} : sup h'^ia) is finite I 
Define gj{a) — X^sg^,^ 5'j(Qi, s)p^(s) , and the following two quantities 




Equivalently, for any arbitrarily small ej > 0, there exists a partition {7Yj,7i^} e such 
that infag-^c gj{a) > g'j —ej. That is, g'j —^j < gj{oi) for a e Tiy Similarly, for an arbitrarily 
small 5j > 0, there exists a partition \^T-Cj,Hj} G such that gj{a) < + 5j for a e Tij. 
Define the expected increase in the function h'^, in any state a, due to customer arrivals as 

E/,- =E„/.(aMa), (2.5) 

where p{a) — Ylj=iPj{^j)j assume that Efj and the second moment E/| are finite. We 
assume that 

^^PaGX^^seSK^H'^' ^^Pa(^) ^ This assumption is valid in most practical situations, 
because the total service quantum available to any queue in any time-slot is bounded. Assume 
that, for each real number rj and for each j, 1 < j < J, the set Z'^{r]) — {a : h^{a) < r}} is 
such that nj{a) is bounded on Zj{r)). Then we prove the following simple observation. 

Lemma 2.3.1 Define h^{a) — Z]j=i h'j{a). Then for each real number r), the set Z'^{r)) — 
{a : h'^{a) < rj} is a finite set. Hence the function h'^ is near-monotone. 



Proof: Since h'^{a) < r] ^ h'j{a) < rj, for each j, we have that nj{a), for each j, 
is bounded on the set Z'^{r]). From the definition of state a, since each residual service 
requirement variable can assume only finitely many values, it follows that Z'^{r]) is a finite 
set. ■ 

Let V : X ^ be a Lyapunov function defined on X . Let TZ'^ C M::[ be the set of customer 
arrival rate vectors such that, for G TZ^ , the Markov chain under the scheduling 
pohcy uj is stable. Define the set 7^^„ G M:[ such that 7^^„ C 7^'^. 

Lemma 2.3.2 For 1 < j < J , assume that (i) h'j : X —>■ IR+ is a real-valued function 
defined on the state space X , and (ii) h'j possesses propertu \2.y.ll Assume that the function 
^ c{a) = 1 + X]j=i ^'ji^) near-monotone and 

^2(9,"-E/,)' 

where g'^ and E/j are as defined in h2.^) and h2.f^) respectively. Then the Markov chain 
n > 0} for the queueing model is c-regular if, for each j , E/j < g'j . ■ 

Proof: For each j, define a function V^, as V^{a) = [h'^ia)] . The expected drift in V}' 
in an arbitrary state a, conditioned on the schedule s to be implemented in the state a, is 

a 

= ^"(«) E -2 ^) - /i («)) + E (^^■(«) - 

a' a 

= -2 s) - E/,) + {Eff - 2gj{a, s)Efj + g]{a, s)) 

The unconditional expected drift AVj{a) is then written as 

sG5k 

where g'j{a) = T.,es^g]{a, s)p'^{s) < oo. 



^'It is possible that a near-monotone function c can arise as a sum of non near-monotone functions h'^ 



Let tj be an arbitrary small positive real number. Then there exists a partition 
{'Hj, 7i^} G such that, for a G 7i^, the unconditional expected drift is bounded above as 

Assume that E/,- < g'^ — ej , and then scale the function V^'(«) as 



2 {g- - e, - E/,) 

Then, for a eHj the expected drift in Vj{a) can be bounded above as 

[Eff-2g,ia)Ef,+g'^ 



AV.ia) < -hUa) + m, for J,(r ' " 



2 [g^ - ej - Ej)) 

Since h'^{a) is bounded for a E Hj, and Efj and g'jia) are finite for 1 < j < J, therefore, 
for a G AVj{a) < —h'j^a) + Jj(2), where Jj(2) is a finite constant. Hence, for all a E X, 
AVj{a) < -h'^ia) + J^, where = max{Jj(l), Jj(2)}. Define = E/=i'^'i(«)- Then, 

for q; G A", 

J J 
AV^(a) = ^ AV,(a) < (-^"(«) + J.) = + J, 

where J = 1 + X]j=i-'i- Since the arguments presented above are valid for any arbitrarily 
small ej > 0, we conclude that the Markov chain is c-regular when E/j < gj" for 1 < j < J. 
As a consequence, the Markov chain is positive recurrent and the function c{a) of the state 
a has finite stationary mean. ■ 

Prom Lemma I2.H.2[ we see that 7^^„ = {EA: Efj < g^ for 1 < j < J} IS an mner- 
bound to the stability region TZ^ of message arrival rate vectors EA. 

Remark: Under the conditions in the statement of Lemma f2.H.2^ Foster's criterion [TT^ also 
holds. To see this, we first observe that the drift AV{a) is negative when c{a) > J. Due to 
near-monotone property of the c-function fLemma l2.3.1|) . the set of states for which c{a) < J 
is a finite set. Hence the drift is strictly negative except possibly on a finite subset of the 
state space. 



2.3.2 A Sufficient Condition for Transience 



In the following theorem, we prove sufficiency of a condition for transience of the Markov 
chain {X^, n > 0} for the queueing model by showing the existence of a Lyapunov function 
that satisfies the theorem for transience stated in Appendix 1X1 

Lemma 2.3.3 Let u be a stationary scheduling policy. For 1 < j < J, let : X ^ M_i_ be 
a non-negative unbounded function defined on X such that h'^ satisfies propertu \2.3.1l Then 
the Markov chain {X„; n > 0} is transient if E/j > for at least one j , where Cj is as 
defined in Ii2.4\ )- ■ 

Proof: Define a Lyapunov function Vj, of the form Vj{a) = 1 — 9^^ where < 9 < 1. 
It can be easily seen that with this choice of Vj, Vj is bounded for all a & X. We now 
show the existence of = for which the Lyapunov function satisfies the conditions for the 
theorem for transience. For a & X, the conditional expected drift AVj(a|s) can be written 

as 



1 - J]0^j('^)-s^(°'*)p(c 



The unconditional expected drift AVj{a), in state a, then becomes 



AV,{a) 



se^K 



sGSk a' 



Define Aj{9) 



AV,-(a) 



. We can observe that AJl) = and 



dAj{9) 



d9 



Given small 6j > 0, there exists a partition [HjjHj} E Ej such that for a E Hj, gj{a) < 
+ 6j and ^^|e=i < + - ^fj- Let Efj > + 6j. We then have ^^\e=i < 0, 
and hence Aj{9) is a decreasing function in ^ at = L Therefore, there exists a < < 1 



such that AVj{a) > for a G H'j. Since h'j{a) is unbounded over the set Hj and by 
the choice of the Lyapunov function Vj{a) = 1 — 9q^^ \ there exists a' G T-Cj such that 
Vj (a') > sup^g^^ Vj{a). Thus we have found a bounded non- negative function Vj{a) = 
1 — 9q^ such that (i) AVj{a) > for a G Hj, and (ii) there exists an a' G Hj such that 
Vj {a') > sup^g^^ Vj{a). 

Since 6j > is an arbitrary small positive number, we conclude from the theorem for 
transience stated in the Appendix |X1 that, n > 0} is transient for E/^ > Gj. ■ 

Now, by further assuming that finiteness of stationary mean for c{a) implies finiteness of 
stationary mean for the number of customers n{a) in the system, we state the following 
theorem on stability of the queueing model. 

Theorem 2.3.1 For the stationary scheduling policy u, the Markov chain {Xn;n > 0} for 
the queueing model is (i) stable ifFifj < g"^ for each queue- j , and (ii) unstable if^fj > 
for at least one queue- j . ■ 

We observe here that the sufficiency result for c-regularity stated in Lemma f2. 3. 21 is defined 
by J conditions, one for each customer class. Now we prove a sufficiency result that is defined 
by only one condition. Assume the existence of a near-monotone function c : X ^ [l,oo) 
that satisfies Property ESIH i-e., c {a') = c(a) + /c(a) —gda, s). Define the expected increase 
in c(a) as E/c = fc{(^)pi^)y gdci) = J^sgSk s)p^{s). Define the set of partitions 
= {{7-^, 'W} : supQ,g-^ c(a) is finite}, and the two quantities g'^ = sup=^ inf aeH'^ fi'c(a) and 
GJ = inf 3^1) supo.g'^c gci^Oi). Now we state the following Lemma 12.3 ."^ 

Lemma 2.3.4 Let u be a stationary scheduling policy. 

(A) Assume the existence of a near-monotone function c : A" [1, oo] that satisfies Prop- 
ertu \2.3l\ Define the Lyapunov function V{a) = 2{g^^Ef ) • ^^^^ Markov chain 
{Xn] n > 0} for the queueing model is c-regular if, E/c < g'^ . 

(B) Let c be a non-negative unbounded function defined on X such that c satisfies prop- 
ertu \2.'J.l[ Then the Markov chain {Xn',n > 0} for the queueing model is transient if 
E/c > ■ 



Proof: Proof of Part (A) is similar to the proof of Lemma f2 . H . 21 and proof of Part(i?) is 
similar to the proof of Lemma [2.3.31 except that we now have V, c, and in places of Vj, 
/ij , and H^, respectively, of Lemma 1!^. 3. 21 



2.4 A General Outer Bound to The Stability Region 
of Customer Arrival Rate Vectors, EjA 

In this section, we derive an outerbound TZout ^ to the region TZ'^ of customer arrival 
rate vectors for each of which there exists a stationary scheduling policy such that the 
corresponding Markov chain {X„; n > 0} is stable. Consider customer arrival processes 
{Aj] I < j < J} and a stationary scheduling policy u that schedules at most K messages 
for simultaneous transmission. Let TZout denote the convex hull of the set of rate vectors 
{r(s);sG5K}. 

Theorem 2.4.1 Let the Markov chain {X„;n > 0}, for the customer arrival processes 
{Aj] 1 < j < J} and the stationary scheduling policy uj, he stable. Then G TZout- B 

Proof: We first observe that, for finite Sj, finiteness of stationary mean for the total 
number of customers in the system implies finiteness of stationary mean for the total resid- 
ual service requirement in the system. Hence, for any customer class-j and under stationary 
conditions, the average service requirement SjWjAj that arrives in a time-slot equals the aver- 
age amount by which residual service requirement decreases in that time-slot due to service 
received. Let {7rK(s);s G iSk} be the probability measure induced on iSk under stationary 
conditions, for arrival processes {Aj] 1 < J < </} and stationary scheduling policy uj. Since 
each of Sj class-j customers can receive a service quantum up to under the schedule s, 
we have SjWjAj < Ylses ^K(s)sj</)j(s) and hence EA G TZout- ■ 



Chapter 3 



Multiaccess Communication with 
Independent Decoding 

We derive a multiclass discrete-time processor-sharing queueing model, of the type developed 
in Chapter 121 for scheduled message communication over a discrete memoryless multiaccess 
channel with independent message decoding at the receiver, when messages are generated at 
random times. 

3.1 The Information-Theoretic Model 

A discrete stationary memoryless channel (DMC) is specified by a finite input alphabet X, a 
finite output alphabet 3^, and a probability assignment {p{y\x); x E X,y E y}. The property 
that the channel is memoryless and is used without feedback implies that, for each positive 
integer N, 

N 

p(yW|xW)=nP(l/nK), 
n=l 

where the A^-length sequences x*-^^ G and y^^^ E y'^ . For a given probability assignment 
Q — {Q{^)'i ^ ^ the input alphabet, we define the average mutual information between 



21 



the channel input X and channel output 3^ of a DMC as 



/(X;F) = 5^5^Q(xMy|x)ln 



x&x yey 



p{x) 



Since I{X;Y) is a function of {Q{x);x G X} for a given transition probability assignment 
{p{y\x);x E X,y E 3^}, we define the capacity C of a DMC as the largest average mutual 
information /(X; Y) , maximized over all input probability assignments. Thus 



Consider the situation when A^-length channel input sequences x*^^-* are to be transmitted 
over the channel in successive channel uses. For each such transmitted input sequence 
x*^^-* the corresponding received sequence y*^^-* is determined, letter by letter, according to 
the channel transition probability assignment {p{y\x)\x & X,y ^ y}. A decoder examines 
the received word, and maps it to an estimate of the transmitted input sequence. 

For > 1 and M > 2, we define a block code (A^, M) to be a set of M channel 
input sequences x^^\ The rate R of the code in natural units is defined as i? = (lnM)/A^. 
A message communication system can be designed by forming a message source that has 
M possible messages to be communicated over the channel. Each A^ units of time the 
source generates a message and the encoder then maps that message to a code word in the 
code {N,M). The Noisy-channel Coding Theorem (Theorem 5.6.2 in states that, for 
R < C, arbitrarily reliable communication is possible in the sense that the probability of 
block decoding error can be made as small as required, and that, for R > C, arbitrarily 
reliable communication is not possible. For R < C, a significant issue to consider is the rate 
of decay of the probability of message decoding error with the length A^ of the code word. 

An upper bound on block error probability exists, that decays exponentially with 
block length A^ for all rates R < C . This bound is derived by analyzing an ensemble of codes 
rather than just one code. The ensemble of codes is generated by choosing each letter of 
each code word independently with the probability distribution Q. We state here Theorem 



C 



sup J(X; Y) 



5.6.2 in that gives an upper bound to the expectation, over the ensemble, of this block 
error probability. 

Theorem 3.1.1 ([Sj) Let a discrete memoryless channel have transition probabilities p{y\x) 
and, for any positive integer N and another positive integer M, consider the ensemble of 
{N, M) block codes in which each letter of each code word is independently selected with the 
probability assignment Q. Then, for each message m, 1 < m < M, and all p, < p < 1, the 
ensemble average probability of decoding error using maximum-likelihood decoding satisfies 



Pg „j < exp {plnM — NEo{p,Q)} , where 

i+p 



Eo{p, Q) 



^Qix)p{y\x) i+p 



(3.1) 
(3.2) 



3.2 The Queueing-Theoretic Model 

In this section we derive a multiclass discrete-time processor-sharing queueing model, of the 
type developed in Chapter |21 for scheduled message communication over a multiaccess chan- 
nel with independent decoding being performed at the receiver, when requests for message 
transmission arrive at random times. This queueing model is defined as in jTSj, by 
considering messages as customers in queue, and the combination of communication channel 
and decoder as server. 

Suppose that a message chosen from a message alphabet of size M is transmitted using 
block encoding and maximum-likelihood decoding, and that the decoding error probability 
is required to be at most Pe- Following the random coding principle, we pick a code book at 
random from the ensemble of block codes {N,M). The message is then communicated by 
transmitting its assigned code word. We choose the code word length N to be the smallest 



positive integer satisfying 



exp{p\nM - NEo{p,Q)} < Pe 

Then, on an average, the decoded message is in error with a probabihty not more than pe. 
Let us rewrite the above inequahty as 

NEo{p,Q) > -\npe + plnM (3.3) 

Inequahty ()3.3p can be used to interpret the above message communication scheme in the 
following way: for any message to be decoded with an expected error probability not more 
than Pe, the message may be viewed as a customer in a queue with a "service requirement" 
of —Inpe + p\nM and that is served by a decoder that provides a "service quantum" of 
Eo{p,Q) in a channel use. 

The "service requirement" and "service quantum" interpretation given above for com- 
munication of a single message can be extended to the context when simultaneous message 
transmissions are allowed and each message is decoded independently, i.e., signals resulting 
from other message transmissions are treated as noise-like interference. In this extension, we 
see that the definition of service requirement remains the same while the definition of avail- 
able service quantum is suitably changed to account for the interference seen by a message 
transmission. 

We assume that a request for message transmission can (i) choose its message value 
from one of a finite number of message alphabets, and (ii) specify the expected message 
decoding error probability. We assume independent and identically distributed quasi-static 
fiat fades from the transmitters to the receiver in the respective channels. With this as- 
sumption, there is an i.i.d. multiplicative gain in the channel from each transmitter to the 
receiver. Thus, for a given multiplicative gain 7, a message signal of average power P will be 
received at the signal power I7P-P. We assume that the multiplicative gain 7 is known to the 
receiver, and is a random variable that has a finite number of finite possible magnitudes. We 
define "class" for a message request by specifying the message alphabet Ai = {1,2,..., M}, 



probability of message decoding error pe, and the multiplicative gain of the channel 7. Thus, 
a message request is characterized by a triple of numbers. For our purposes, we assume that 
a message request can assume one of J > 1 different message classes {M.j,Pe,j^lj)^ where for 
1 < j < J, J^j = {1, 2, ... , Mj} and 7^ is the jth multiplicative gain value. 

Next, we allow scheduling of multiple messages for simultaneous transmission, i.e., 
signal transmissions from the same message class can overlap in time. Let s G iSk be as 
defined in Chapter |21 Let Xj denote the set of channel input letters for class-j , and Qj = 
{Qj{xj); Xj G Xj} be an arbitrary probability assignment on Xj. Consider a schedule s G 5k. 
Define the channel vector input x'^ = (x^; all j, I < j < J, such that Sj > 0, and I < k < Sj) , 
where Xj G Xj. Then, for the schedule s, the communication channel under consideration 
is the multiaccess channel with the transition probability law Assuming random 

coding, for each j, 1 < j < J, such that Sj > 0, define the effective channel transition 
probability law [pj{y\xj); Xj G Xj;y E for a class-j message under the schedule s as (see 
Fig. EH) 



Pj{y\xj 



> 1 









► 






Figure 3.1: Equivalent DMC seen by a class-j message under the schedule s 



For an arbitrary A^-length code word x 



(TV) 



{xj{l); 1 < I < N) from the set Xj and 



an A^-length schedule sequence s^^^ = [s^, s^, . . . , s^), where s" G {s G iSk : Sj > 0} , we 



define that p ( y 



x^f^\ g(Af) j _ JI^^^pI" Xj{n)) , and the N channel uses may be non- 
contiguous. We can show the following Theorem by extending the proof of Theorem 13.1.11 
(Theorem 5.6.2 in j3]). 



Theorem 3.2.1 Let the effective discrete memoryless channel as seen by a class-j message 
transmission under the schedule s such that Sj > have the transition probabilities Pj{y\xj). 
For any positive integer N and the message alphabet size Mj, consider the ensemble of 
{N, Mj) block codes in which each letter of each code word is independently selected with the 
probability assignment Qj. Then, for each message rrij, 1 < rrij < Mj, and all p, < p < 1, 
the ensemble average probability of decoding error using maximum- likelihood decoding satisfies 



N 



Pe 



< 



3) ( 1 



n=l 



y&y 



where 



(3.4) 



For independent Gaussian encoding of messages with power Pj = I'yjf P, we can 
evaluate E^ , (p, Qj) in ()3.4p . and the value is given below. For s G {s G iSk : sj > 0}, 



KjiP^Qj) = Pln(l + , . t] (3.5) 

V (1 + P) [(ELi ^kPk) - P, + NoW\ J 

Suppose that a class-j message signal is scheduled as part of the schedule s G {s G iSk : Sj > 0} 
for dj{s) possibly non-contiguous channel uses. For a given tolerable decoding error proba- 
bility Pej, assume that the upper bound on the expected message decoding error probability 
satisfies the inequality Pe,m^ ^ Pe,j so that 

d,{s)El^{p,Q,) > -\np,,+p\nM, (3.6) 

se{s€SK:Sj>0} 

By extending the interpretation given to inequality 13.31 to the inequality 13. (i| we can ob- 
serve that the definition of service requirement remains the same, whereas a message service 



quantum now is E'^j (p, Qj) thus reflecting interference. We say tliat tlie message code word 
lengtli is Nj = J2se{seSK-Sj>o}^j(^) ^^^^ message received a cumulative service of 
'^se{seSK Sj>o}^i^^^^o,j (P^Qj) '^^^^ cliannel uses. We sliould observe fiere tliat, for a 
given pej, there may exist many different solutions {dj{s); s & Sk and Sj > 0} such that the 
cumulative service equals or exceeds — Inpe ^ + plnMj. 

Definition 3.2.1 (Service Requirement) For 1 < j < J , a class-j message service re- 
quirement is denoted by Sj < oo and is defined by Sj = — Inpej + plnMj. 

Definition 3.2.2 (Service Quantum) For K > 1 and 1 < j < J , a class-j message under 
the schedule s G {s G iSk; Sj > 0} can receive a service quantum of magnitude E^ - (p, Qj) > 
in a channel use. 

In the notation of Chapter El define the available service quantum to a class-j message as a 
function of the schedule s as 

(pj[s) = ( (3.7) 
1^ if = 

A few remarks on the definitions of service requirement and service quantum are in order. 

• A significant difference between a message's service requirement and its available ser- 
vice quantum is that the former quantity depends only on the message class whereas 
the available service quantum depends on the particular schedule s and its message 
class. This observation implies that a message can be offered different service quanta 
under different schedules. 

• For a schedule s G 5k, it is possible that the total available service quantum Sj(f)j{s) 
to queue-j is different for different queues. Then in that case, we have a multiclass 
non-uniform processor-sharing queueing model. 



Having defined a service requirement for a message transmission, and modeled the decoder 
by a server, we are now in a position to analyze this communication scheme when requests for 



message transmission arrive at random times. The model for random generation of message 
requests for transmission is as given in the Chapter |21 In this setting, messages transmit their 
signals over a random duration (equivalently, code words of random length), determined by 
the message arrival processes and the service statistics of the server. 

In the rest of this chapter, we consider two classes of stationary scheduling policies: 
for an integer K > 1, we define (i) non-idling policies, denoted by i^K, and (ii) "state- 
independent" scheduling policies, denoted by Q^. For each scheduling policy u, we define 
a discrete-time Markov chain for the queueing model, evolving on the countable space X of 
states a, as defined in ()2.1|) of Chapter |21 We then analyze for the stability fDefinition l2.2.2|) 
of the chain. These stability results are derived by obtaining appropriate drift conditions for 
suitably defined Lyapunov functions V{a) of the state of the Markov chain. In particular, 
we prove that the Markov chain is c-regular and stable by applying Theorem 10.3 from [10\ . 

3.3 Stability Analysis for the Class of Non-Idling 
Scheduling Policies 

Define iSk = |s G 5k : J2j=i — '^|' {T^k, '^kI ^'^ t)e a partition of X such that = 
{a & X : n{a) > K}. Define S'^ = [s E Sk '■ Sj < nj^a) for 1 < j < J} to be the set of all 
feasible schedules in state a that schedule exactly K messages for simultaneous transmission. 
A scheduling policy G is defined by (i) the mapping : A" — 5k, and (ii) a probability 
distribution {p^(s);q; G X and s G iSk} with the following two properties: (i) ^^(s) = if 
s is an infeasible schedule in state a, and (ii) 'Yls&s'^P'ai.^) = 1 for a G l-C^. Thus the 
policy uj ensures that some group of K messages are scheduled for transmission whenever 
there are at least K messages present in the system. Define (j). = min|_,gj^.^^Qj 
(pj = max{sg5^} 0j(s). We introduce the notation that, for any x > and q > 0, \x]q = 
min(n > 1 : x < nq)q. 

Lemma 3.3.1 LetK > 1, J > 1 andoo e n^. For a G X, letc{a) = 1 + E/=i Efc= 



and 



V{a) 



2 - e;=i ea, 

Then the Markov chain is c-regular and stable if Y2j=i 



< K. 



Proof: Let aj class-j messages arrive in state a and that the feasible schedule s is 
implemented in the state a. Assuming that the chain moves to state a', we have 



c(a') 
Ma) 



c{a) + fc{a) - Qcia, s), where 

EE 

j=i k=i 



Xj{k) 


I{x,{k)<<t>,{s)} + ^ 
















—J 




—3 




—J 



that 



We now consider a G 7^j<;. We show that J2seSK 3^^^' ^^P'^t^^^ — ^' ^^^^ observe 
> 1 since Xj{k) > 0. Consider S'^. Hence (f)j{s) > (p.. For Xj{k) > (f)j{s), since 



(k) 



Xj (fc) 



> 1. Hence g^a, s) > K and Y^ses^ 9c{<^^ s)Pa{s) > K for 



a 



G T^K- But the expected increase E/c in c(a) is ^^^^ 



Assuming Y^Ui 



< K, and then applying Part(A) of Lemma 12.3.41 to c{a) 
and V{a) as defined in the statement of Lemma 13.3.11 we find that the Markov chain is 
c-regular. Since c{a) > n{a) for every a, existence of finite stationary mean for c{a) implies 
existence of finite stationary mean for n{a). Hence the Markov-chain > 0} is stable. 



Xj{k) 



is the maximum num- 



Remark: For Gaussian encoding of messages, we can see that 
ber of code symbols that a message with residual service requirement Xj{k) would possibly 
transmit. Thus c{a) gives the maximum total outstanding number of code symbols in the 
system still to be transmitted in state a. 



Lemma 3.3.2 Let K > 1, J > 1 and cu E Hk- For a E X , define 

c{a) = 1 + + (t>j) , and 

j=i k=i 



Then the Markov chain is c-regular and stable ifYlj=i {^j + ^j) < ^^^ss^k ^i=i ^J^i(^) 



Proof: Let aj class-j messages arrive in state a and that the feasible schedule s is 
implemented in the state a. Assuming that the chain moves to state a', we have 

c(a') = c{a) + fc{a) — gc{a, s), where 
J 

fc{a) = ^ (S'j + 0j) , and 
i=i 

gda, s) = XI 5Z [(^i(^) + ^j) h^j{k)<4>,{s)} + 0i(s)^{x,(fc)><^,(s)}] (3.8) 
i=i k=i 

We now consider a E 'H'^. We show that X^sg^^^ 5'c(tt, s)p^(s) > min^^;^^^ i ^i^ii^) ^'^^ 
a E H^. Since a;j(/i;) + 0^- > (t>j{s), we can see from ()3.8|) that (7c(tt5 -s) > J2j=i ^j4>j{^)- Since 
= for s ^ 5k and a E H^, we have that for a E H'^, 

J2 9c{a,s)pl{s) = J] > ( J > mm J] 

se5K se^K se5K \i=i / '^^'^'^ i=i 

But the expected increase E/c in c{a) is (5'j + 0^) . Assuming that EAj ^S'j + < 

min^gj^ ^^^-^ and then applying Part(A) of Lemma Pi. 3. 41 to c{a) and V{a) as de- 

fined in the statement of Lemma I3.3.2| we find that the Markov chain is c-regular. Since 
c(a) > 1 + (miuj 0^) n(a) for every a, existence of finite stationary mean for c(a) implies 
finite stationary mean for n^a). Hence the queueing model n > 0} is stable. ■ 



Lemma 3.3.3 For K > 1, J > 1, and for any non-empty subset B of the set {1, 2, . . . , J}, 



the Markov chain is unstable if, Xljes ^j^^j — "^^^seSK Sje_B ^j^ji^)- ' 

Proof: For each non-empty subset B of the set {1, 2, . . . , J}, define the function c^{a) = 
'^j&B 'Y^='i' ^i(^)) s-^d then the Lyapunov function Vb = 1 — 6''^'^^"^ for < < 1 on the 
state space X. Then we have the following: 

{a) = c^{a) + fcB{a) — gcB{a, s), where 
fcB{a) = ^ctj, and 

gcB{a,s) = ^^min {xj{k),(j)j{s)} 

jeB k=l 

Since = for a G TC^ and s ^ Sk, we have the following inequalities for a E H^: 

^e^K ^g5K seSK VjeB / ^^'^'^ jes 

By applying Part (B) of Lemma [2.3.41 to Vb(«), we find that the Markov chain is unstable 

For certain specific values of K and J, exact characterization of message arrival rate stability 
region can be found. 

Theorem 3.3.1 Let u; G f2K- 

(A) Let either K = 1 and J > 1, or K> 1 and J = 1. Then the Markov chain is (i) stable 



< K, and (ii) unstable if^i^i^Aj 



> K. 



(B) Let J > 1. Then, for Gaussian encoding of messages and in the limit K ^ oo , the 
Markov chain is (i) stable if J2j=i^^j^j < j+p > ^'^^ ('^'^) unstable if "^j^i^AjSj > 



p 



Part {B) of Theorem KlH.ll says that, in the hmit K —>■ cxd, the upper bound on 
stable throughput achievable with E^j{p,Qj) defined in ()3.5p is independent of message 
SNR-s and their distribution. The stability results for the continuous-time models in J3] 
and [121 coincide with the corresponding result, stated in Part (B) of Theorem IH.H.H for the 
discrete-time model in the limit of large number of simultaneous transmissions. 

Proof: Part(i) of Part (A) is proved in Lemma 13.3.11 To prove Part(ii) of Part (A), 
consider c{a) as defined in Lemma 13.3.11 and the Lyapunov function V{a) = 1 — 9^^"^ for 
< 6^ < 1. We observe that J^s^Sk 9c{c(^ ^)Pai^) can be uniquely determined for the following 
two special cases. For a G Ti.^, 



^^c(a,s)K(s) 

seSK 



1, if K = 1, J > 1 
K if K > 2, J = 1 



By applying Part(i?) of Lemma 1!^. 3. 41 to V{a), we find that the queueing model is unstable 
if Y.j^i > K for either K = 1 and J > 1, or K > 2 and J = 1. 

To prove Part {B), we first observe that, for E'^j {p,Qj) as defined in ()3.5|1 . 

J J 
lim min'S^ Sj(f)j{s) = lim max Sj0,(s) = — - — 

Also, for 1 < j < J, limK^oo 5'j + (f)j = Sj since limK-^oo^j = 0. Proof now follows from 
the sufficiency condition for stability stated in Lemma 13.3.21 and the sufficiency condition 
for unstability stated in Lemma 13.3.31 with B = {1,2, . . . , J}. We observe that the inner 
bound stated in Lemma 13.3.21 and the outer bound stated in Lemma 13.3.31 coalesce in the 
limit K — s> oo. ■ 

Figure 13.21 shows plots of message arrival rate stability threshold versus K, for the 
special case J = 1 and for different values of F with parameters p, Mi and pe,i fixed. From 
these plots we see that, for sufficiently small transmit powers, as many simultaneous message 
transmissions as possible should be scheduled, i.e., immediate access should be granted to 
messages to increase the throughput of the system. For large transmit power, scheduling 
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Figure 3.2: Message arrival rate stability threshold versus maximum number of simultaneous 
message transmissions, K, in the case J = 1. 

many transmissions hurts the system throughput. This behavior can be explained as fol- 
lows. For small transmit powers, the effective noise seen by a transmission arises mainly 
from thermal noise, rather than from interference caused by other ongoing message trans- 
missions. Thus, interference from other signal transmissions has insignificant effect on any 
given transmission, and scheduling as many transmissions as possible is advantageous from 
the stability view point. For large transmit powers, interference dominates the effective noise 
seen by any message transmission. Hence, limiting the number of simultaneous transmissions 
is desirable. 



3.4 Stability for State-Independent Scheduling Policies 

In this section we consider the class of stationary state-independent scheduling policies. 
Before we formally define a policy uj in Q^, we first introduce the notions of sub-schedule 



and maximal sub-schedule. 



Definition 3.4.1 (Sub-Schedule) For K > 1 and s,s' G 5k, we write s' ^ s if s'j < Sj 

for 1 < j < J- We then say that s' is a sub-schedule of the schedule s. The maximal 
sub-schedule of the schedule s in state a is denoted by s*{s,a) G Sk, and is defined by 
s*{s,a) = mm{sj,nj{a)} for I < j < J. ■ 

We should observe that (i) s*{s,a) for a given schedule s can be the zero schedule in some 
states a, (ii) in a given state a, it is possible that s*{s, a) = s* (s, a) for some two schedules 
s, s E Sk, and (iii) for E^j (p, Qj) given in ()3.5|1 . 0j (s') > 4>j{s) for s' ^ s and I < j < J. 

Define = {t E S^i : t = s*{s, a) for some s G 5k} C to be the set of maximal 
sub-schedules ^ in state a. For an arbitrary probability distribution {p'^{s);s G Sk} and 
a E X, define the probability distribution {^^(s); a E X and s G S^} by defining 

Pais) = (3.9) 

{teSK-f{t,a)=s} 

Formally, a policy uj G is defined by a probability distribution {p'^(s); s G 5k} together 
with the collection of the random variables {uj{a); a E X}. For a E X, the schedule u!{a) to 
be implemented in state a is a random variable that takes values in the set of maximal sub- 
schedules with the probability measure {Pais)', a E X and s E S^} defined in 13 .91 The 
name "state-independent" for the class of policies is a misnomer . The actual schedule 
uj{a) that gets implemented depends on the state a in conjunction with the probability 
measure {Pq(s); s E S^}. The name "state-independent" is used because specification of the 
probability measure {p'^(s); s E 5k} is independent of the state. 

Lemma 3.4.1 ForK>l,aEX,ujEQ^ and l<j<J, define h'^ia) = {xjik)+^j), 
c{a) = 1 + Y.j=i 



^ Every schedule in <S^ is a feasible schedule. 



Then the Markov chain is c-regular and stable if (^Sj + 0^) EAj < '^s^s^^p'^{s)sj(f)j{s) for 
1<J<J- ■ 

Proof: We note here that, in any time-slot, the schedule s G 5k will be chosen with 
probability p'^(s), and the corresponding maximal sub-schedule s*{s, a) will get implemented 
in the state a. Then s*(s, a) class-j messages will be scheduled in state a and each of them 
can receive a service quantum up to 0j {s*{s,a)). Let aj class-j messages arrive in state a 
and that the feasible schedule s is implemented in the state a. Assuming that the chain 
moves to state a', we have 

/ij {a') = ^^{a) + fj{a) — gj{a, s), where 
fj{a) = aj (^Sj + 4>j) , and 

J2k=i + /{x,.(fc)<^,.(s)} + 0j(s)/{^^.(fc)>^^.(,)}] if Sj > 



gj[a,s) 



if Sj = 



Let [T-Cj,Hj} be a partition of X and define Hj = {a: nj{a) > K}. For a G Hj, we have 
that Sj{s,a) = Sj and 

Yl 9, («, s)pl{s) > P'^it)s,(j),{s) = Y P''{s)sMs), 

where (a) follows from the fact that gj{a,s) > Sj(f)j{s). But the expected increase E/j in 
h'j{a) is [Sj + (pj) FiAj. Assume that (^Sj + (pj) EAj < X^ssSk ^-PPlyi^ig 
Lemma (2. 21 to the functions c{a) and V{a) as defined in the statement of Theorem IH.4.H 
we find that the Markov chain is c-regular. Since c{a) > 1 + (min^ 0^) n{a) for every a, the 
number of messages n{a) in the system has finite stationary mean. Hence the Markov-chain 
{Xn, n > 0} is stable. ■ 



3.5 



Interpretation of Information Arrival Rate Stabil- 
ity Region in terms Information-Theoretic Capac- 
ities 



In this section we interpret the information arrival rate stabihty region in terms of interference- 
hmited information-theoretic capacities. Define Aj = {In Mj) WiAj. Then EA^ = (InMj) EAj 
and = ^EAi, Ey42, . . . , EAj^ denote the nat arrival rate into queue-j and the nat ar- 
rival rate vector, respectively. Define Tj = be the received SNR for a class-j message 
transmission, 

Theorem 3.5.1 (Capacity Interpretation for u G ^k) Assume Gaussian encoding of mes- 
sages. 

(i) Let J = 1. Then, in the limit Mi — > oo and p — > 0, the threshold on EAi approaches a 
limit that is equal to K times the information-theoretic capacity of an AWGN channel 
with SNR (-K-i)ri+i ' 

(a) Let J > 1 and K ^ oo. Then, in the limit min^ Mj oo and p ^ 0, the threshold on 
^2"^=! approaches the limit 1 nat/s/Hz. ■ 



Proof: Part (i): For J = 1, we know from Part {B) of Theorem KIH. II that the system 
is stable if F,Ai ^ < K, or equivalently, EAi < Since [S'l],^^ = [— Inpe^i + 

plnMi]^ = — In Pel + pin Ml + d, where < d < we have the following lower bound 
and upper bound on nat arrival rate threshold. 



K^^ In Ml K(p^ In Mi K^^ In Mi 

—1 ^ —1 — ^ —1 



- Inpe^i + plnMi + 0^ [- lnpe,i + plnMi]^^ - Inpe.i + plnMi 
Since — j — , , and '^^i '"^ g^^e increasing functions of Mi, and 

K0 InMi K0 InMi K0 
lim = lim = 

Afi^oo — Inpe.i + plnMi + A/i^oo — Inpe.i + plnMi p 



we have that for any given positive integer there exists a positive integer Mf > Ml 
such that '^^i^'^^i ., > that lim,, - '^^i^"^^ - '^^i 

Further, for E^^ (p, Qj) as defined in ()3.5p . hnip^o = K In ^1 + (KrY^rT+r) ' 

Part (ii): For K — ^ oo, we know from Part (C) of Theorem KIH. II that the system is stable 
if "^j^i^AjSj < j^, or equivalently, X]j=i ^E^ikTM" ^ T+p- -^^^ positive Pej, we have 
i^jj- — > p in the hmit Mj —> oo. Thus we have < hmit miuj Mj oo. 

But — >■ 1 as p — >• 0. Thus, we have < 1 in the hmit min^ Mj oo and p ^ 0. 



For each s G 5k, define the vector C(s) = (Ci(s), C2(s), . . . , Cj(s)) of interference-hmited 
capacities by defining 




if = 



Theorem 3.5.2 (Capacity Interpretation for u E Q,^) Let J > I and K > 1. Consider 
a state-independent scheduling policy oo = {p'^{s)]s G 5k}. Then, for Gaussian encoding of 
messages, and in the limit Mj — > oo and p — > 0, the threshold on EAj approaches the limit 

Proof: We know from Lemma f3 .4. II that the queueing model is stable if the nat arrival 
rate for class-j satisfies the inequality EAj < X^sg^K P'^('^)'^j^j('^) • ^^^^ s'+i- increases 
to ^ in the limit Mj oo and, further, ^^'^^'•'^•^ — * Cj{s) in the limit p — > 0. Thus we have 

For state-independent policy u, define the inner bound 

7^r„ =IeA: [S, + 0j EAj < J2 for 1 < J < J I 

to the stability region TZ'^ of message arrival rate vectors EA. For s G 5k, define the set 
of vectors {r'{s);s G 5k} by defining r'As) = %^rx^. We observe that IJ^poK 7?.^ is the 



convex hull of the rate vectors {r'(s); s G Sk}- The interpretation is that the convex hull of 
{r'{s); s G 5k} represents a region of message arrival rate vectors stabilizable by the class 
of state-independent scheduling policies. Now we give an interpretation to the achievable 
stability region UweoK terms of interference-limited information-theoretic capacities. 

For s G iSk, define the sets of vectors {r(s); s G iSk} and {r'(s); s G iSk} by defining 
the components rj{s) = {lnMj)rj{s) and r^(s) = (In Mj)r^(s), respectively. In the following 
corollary, we show that the class of state-independent scheduling policies achieve any 
nat arrival rate vector that is achievable by stationary scheduling policies in the asymptotic 
limit miuj Mj oo corresponding to large message lengths. 

Corollary 3.5.1 In the limit mini<j<jMj oo, we have 

(i) convex hull of {r'(s); s G 5k} = convex hull of {f{s)\ s G 5k} 

(ii) in the further limit p —>■ and for Gaussian encoding of messages, convex hull of 
{f(s); s G 5k} = convex hull of {C{s); s G 5k}. 



Proof: For a schedule s such that s,- > and for positive Pe Misim^oo tt-tt" = ; ^-^id 
hence f'g{s) the limit Mj oo. Hence the convex hull of {r'{s) \ s G 5k} 

= convex hull of {r(s); s G 5k}. For , {p,Qj) defined in we have ^i^i^ Cj{s). 

■J p 

Hence the convex hull of {r(s); s G 5k} = convex hull of {C(s); s G 5k}. ■ 




Figure 3.3: Nat arrival rate threshold versus maximum number of simultaneous message 
transmissions, K, in the case J = 1. 



Chapter 4 



Multiaccess Communication with 
Joint Decoding 

We derive a multiclass discrete-time processor-sharing queueing model for scheduled mes- 
sage communication over a discrete memoryless multiaccess channel with joint maximum- 
likelihood decoding, when requests for message transmissions arrive at random times. We 
show that the stability region of information arrival rate vectors is the information-theoretic 
capacity region of a multiaccess channel. 

4.1 The Information-Theoretic Model 

Consider a discrete stationary memoryless multiple access channel over which J independent 
message sources communicate to a receiver. Assume that source- j has Mj > 2 possible 
message values to choose from the message alphabet Aij = {1,2,..., Mj}. Let M denote 
the vector of source message alphabet sizes (Mi,M2, . . . ,Mj). For 1 < j < J, define the 
finite set Xj to be the set of channel input letters into which the source-j output will be 
encoded, and xj-'^^ be the Cartesian product ^ of n copies of Xj. Then x^'^^ e '^i^^ > 1, 

^Throughout this chapter the notation that we use to denote code words has the foUowing interpretation. 
The superscript is a positive integer and designates the code word length. There can be more than one 



40 



is an A'"-length sequence of letters from the set Xj. There is a finite output alphabet y and 
a channel transition probability assignment {p{y\xiX2 ■ ■ ■ xj);y e y; Xj e Xj for 1 < j < J}- 
The channel is memoryless in the sense that if x^^'' — (xj(l),Xj(2), . . ., Xj(N)) is an A'"-length 
sequence from the set Xj, then the probability of receiving y^^^ — {yi,y2, ■ ■ ■ ,yN) for the 
given set of codewords x^^^ = {x[^\x2^\ . . . , x[^^} is 

N 

p (y^^^ = JJp(y„ \xi{n)x2{n) . ..xj{n)) 

n=l 

Let rrij e A4j and rhj e Aij be two random variables that represent source-j output and its 
estimate at the receiver. Define the joint message m = {mi,m2, ■ ■ ■ jfrij) G Xj^^Aij. Con- 
sider block encoding at the respective sources with block length N and using Mj codewords 
for the jth source. Let ja^j^"* ■ ^ < k < Mj | represent the code book for the jth source. We 
shall refer to a code ja^^^^ i < j < J', i < k < Mj^ as an {N, M) code. 

Each N units of time and for each j, source- j generates an independent random 
integer ruj uniformly distributed from 1 to Mj. The encoders transmit the respective code 
words x^l^2,j — j,mj{^) 1 X j,mj{'^) 1 ■ ■ ■ i ^3,mj{N)^-i ^-nd the corresponding channel output y^^"^ 
enters the decoder, and is mapped into a decoded joint message m = {rhi,rh2, ■ ■ ■ , rhj). If 
rh = m, i.e., rhj = rrij for each j, the decoding is correct, otherwise, a decoding error occurs. 
The probability of decoding error Pe is minimized for each y^^^ by a maximum-likelihood 
decoder by choosing m — (mi, m2, . . . , rhj) that maximizes p (^y^^^ ' -^2^2 ' ■ ■ ■ ' -^J^Jij ) ■ 

For each j, define Xj G Xj to be a random variable and define Qj = {Qj{xj)] Xj G Xj} 
to be an arbitrary probability distribution on the set Xj. Let S denote any non-empty 
subset of the set of sources J — {1,2,..., J}. Define the vectors x — (xi, 2:2, . . . , xj), 
x{S) = {xj-J G S), = {xk;k G 5^), X{S) = {Xj-J g S}, and X{S) = {X^^ke S'^}. 



entry in the subscript. When multiple entries are included in the subscript, they are separated by commas. 
The first entry gives the identification of the source and the second entry gives the possible message value 
from that source. For example, x'""^ (1) denotes the Zth symbol of a n-length code word assigned for the fcth 

message value of the jth source. In a slight abuse of notation we use the notation xj^k in place of x^^l{l). In 
situations when we do not want to be specific about the particular code word of a given source, we simply 
ignore the second entry in the subscript. For example, xj"^ denotes an n-length code word for the jth. source 
and a;^"' (Z) is its Zth symbol. 



Then define Qs{x{S)) = Ylj(zs Qji^j), QiS") {x^S")) = Ylkes^Q^i^k) to be probability 
distributions on the product alphabets {Xj^gXj) and (XkeS'^^k), respectively. Finally, define 
the product probability distribution Q = ^Q{x) = Y[j=iQji^j) '■ ^ Consider an 

ensemble {N,M) of codes in which each code word x^^^., 1 < j < J and 1 < rrij < Mj, is 
independently selected according to the probability distribution 

N 

HQj {xj,m,{n)) (4.1) 

n=l 

We state here the following theorem which defines the capacity region C of a multiaccess 
channel. 

Theorem 4.1.1 ([4J) For a given product probability distribution Q, define the pentagon 
T{Q) to be the set of rate vectors r = (ri, r2, . . . , rj) G M.'^ satisfying 

5^r, < I{XiSy,Y\X{S'^)) 

for each S G 'P{J). The capacity region C is then defined as the convex hull of these pentagons 
over all possible product probability distributions Q, i.e., C = convex hull of ^|JqX((5) j • ■ 

For each code in the ensemble, the decoder uses maximum-likelihood decoding, and we wish 
to upper bound the expected value p^ of Pe for this ensemble. Define V{jJ) to be the set 
of all non-empty subsets of the set JT". For a given S G V{J), we define the decoding error 
event to be of the type-S if the decoded joint message rh and the original joint message m 
satisfy: rhj ^ rrij for j G S* and rhk = rn^ for k G S'^. Let p^ g be the expectation of the 
probability of a type-S" decoding error event over the ensemble; obviously p^ = J2seviJ)Pe,s- 
The following Theorem is stated in [H], |HI and the proof of the Theorem for two sources is 
given in (7j. 

Theorem 4.1.2 (f7l|) Consider an ensemble {N, M) of block codes in which, for eachj, code 
words x^^^ in the code book are independently chosen according to \4-l\) for a given probability 
distribution Qj. Then the expected error probability over the ensemble is Pe\m = J2sPe,s\m> 




where for < p < 1, 



Pe,S\m < exp 



-N 



'J2Rj + EoAp, Q) 



and 



xiS'^) y 
\nMj 



1 i+p 



J2Qs {x{S)) p{y\x)^^ 

x{S) 



N 



for 1 < j < J 



For future reference, we denote the random coding upper bound on the expected joint 
message decoding error probabihty by 



X{J,N) = J2 



-N 



ie5 



We note here that x(<^) ^) ^-Iso serves as an upper bound on the expected individual mes- 
sage decoding error probabihty. This foUows because, for 1 < j < J, the expected proba- 
bihty, over the ensemble, that the jth source message is in error satisfies: p {m'^ ^ rrij) = 
J2{S€ViJ)-jes}Pe,s < xiJi^)- Since no closed form expression exists for A^, we derive an 
upper bound and a lower bound to in Lemma [4.1.11 



Lemma 4.1.1 For a given tolerable joint message decoding error probability Pe, let N be the 
smallest positive integer such that x{.Ji ^) ^ Pe- Then 



max 



EoAp^Q) 



< N < max 



Eo,s{p,Q) 



EoAp^Q) 



Proof: Since x(j7', A^) < Pe, we have that exp[—N[Eo^s{p, Q) — pJ2jes Rj]] — Pe 



each S e V^J). Equivalently, 



N > 



i.e., > max 



-lnpe + p^j^glnMj 



ys e V{J), 



sevij) Eo^s{P: Q) 



i.e., N > max 

seViJ) 



Eo,s{p,Q) 



To derive the upper bound, we observe that for at least one subset 5* e P(J'), it is true that 
exp[—N[Eo^s{P: Q) — p'l^jes^jW — 2^=T' least one term in x(J', A?") is greater than 

or equal to when the sum of 2-^ — 1 positive terms equals Pe- Let exp[— A^[£'o,5(p, Q) — 
PY^jes^j]] ^ 2^ for some subset S eV{J). Then it follows that 



TV < „ , < max 



Eo,s(p,Q) 



Hence the Lemma is proved. ■ 

When a joint message consists of messages from all sources in the set J, assume that 
the codeword is of length A'^ in order that the given tolerable joint message decoding error 
probability pe is met. Then, for any subset S G 'P{J) of sources, when a joint message 
consists of messages from all sources in the subset the codeword needs to be of length at 
most N in order that the same tolerable joint message decoding error probability p^ is met. 

Lemma 4.1.2 Let N he the smallest positive integer such that X A?") < p^, and S e 
V{J). Thenx{S,N)<x{J,N) ■ 



Proof: 



pJ2^nMj~NEo,s' {p,Q) 



X{S, N) 



4.2 The Queueing-Theoretic Model 



We now define a J-class discrete-time processor-sharing queueing model for tlie J source mul- 
tiaccess cliannel with joint maximum-hkehhood decoding considered in the previous section, 
when requests for message transmission arrive at random times. 

In Section 14.31 we consider stationary scheduhng pohcies that schedule multiple mes- 
sages with the same message alphabet for simultaneous transmission. Consider the set 5k 
of schedules as defined in Chapter |21 To interpret Theorem I4.1.2| and results from Lem- 
mas and ^^21 for the schedule s G 5k, it is convenient to view the schedule s as defining 
a new multiaccess system that has J{s) = {1,2,..., J(s)} as the set of message sources, and 
message alphabets AAj{s) for 1 < j < J{s). Define m(s) = (mi(s), m2(s), . . . , mj(s)(s)) , 
where mj{s) G -Mjis) for 1 < j < J{s), to be a joint message under the schedule s. For 
the scenario (SI) described in Chapter [TJ we then have J(s) = X]j=o -^{«j>o}' sched- 
ule s defines new message alphabets for message sources that are product versions of their 
original message alphabets. For example, for source-j in J' and for the schedule s such 
that Sj > 0, this product message alphabet, denoted by Aij{s) = |l, 2, . . . , Mj*^ }, is the 
Cartesian product of Sj copies of the original message alphabet Aij. In other words, we will 
be encoding Sj messages jointly under the schedule s. Wth this view point, we redefine the 
coding rate Rk in Theorem 14 . 1 . 21 for the scenario (SI) as Rki-s) = ^''j^"^-)^'' thus emphasizing 
the dependence of effective message alphabet size on schedule s. For the scenario (S2), we 
have J{s) = J2j=i ^j^ of which sj sources have ^Aj as their message alphabet for 1 < j < J. 



Under this scenario, each message is encoded independently. Let V{J{s)) denote the set 
of all non-empty subsets of the set J{s). In the rest of this chapter, we define N{s) for a 
non-empty schedule s to be the smallest positive integer such that x (•^(■s), ^i.^)) < Ve- 

The service requirement N{s) of a message depends on the schedule s for which the 
message is a component message of a joint message. The service quantum available to a 
queue at a discrete-time instant depends on the schedule employed at that instant. Define 



to be the service quantum available to a class-j message under the schedule s. Then the 
service quantum available to queue-j is Sj units, and the total available service quantum 



quantum available to, a message in the case of independent decoding and joint maximum- 
likelihood decoding: (i) in the case of independent decoding, message service requirement 
characterization depended only on the message class — whereas for joint decoding, it depends 
on the particular schedule, and (ii) both 5*-,- and are positive integers for joint decoding 
— whereas they are positive real numbers for independent decoding. Figure 14.11 shows the 
queueing model for J = 2. 

We are interested in characterizing an outerbound to the region of message arrival 
rate vectors for which the queueing model for joint maximum-likelihood decoding is 
stable for the class of stationary scheduling policies. In the spirit of the discussion given in 
Section ED of Chapter El define, for s G Sk, the rate vector r(s) = (ri(s), r2(s), . . . ,rj(s)) 
by defining rj{s) = if sj > 0, and rj{s) = if Sj = 0. With this definition of the 
rate vector. Theorem 12.4.11 can be applied to the present context except for the following 
difference: for 1 < j < J and s G iSk such that sj > 0, define WiAjs as the stationary rate at 
which messages in queue-j are assigned to joint messages of the schedule s for transmission. 
Then EAjsN{s) < ni^{s)sj. That is, EAj < ^^^^ 7rK(s)rj(s). 




is Ylj=i units. We make two observations regarding service requirement of, and service 
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Figure 4.1: Example of the queueing model. There are two queues with mean arrival rates 
WiAi and W1A2, respectively. Individual messages that are part of a joint message are shown 
by encircling them by a dotted line. We can see that messages 4, 5, . . . , ni in the first queue 
and messages 3, 4, . . . , n2 in the second queue are not yet assigned to a joint message of any 
schedule. Messages 1 and 2 from the first queue, and the first message from the second 
queue constitute a joint message of the schedule (2, 1). The second joint message conforms 
to the schedule (1, 1), and consists of the third message from the first queue and the second 
message from the second queue. 

4.3 Stability for State-Independent Scheduling Policies 



In this section we define the class of stationary state-independent scheduling policies, 
and then characterize the stability region TZ'^ of message arrival rate vectors WiA for each 
such policy u G Q^. To implement a scheduling policy u, we further classify class-j messages 
incoming to queue-j based on the particular subclass- (j, s) to be assigned to them. 

For s E Sk and 1 < j < J, we say that the pair (j, s) defines a subclass if Sj > 0. 
For Sj = 0, the pair (j, s) does not define a subclass. For each class-j message arrival, a 
subclass- (j, s) is chosen independently and at random with the fixed probability distribution 
defined later in ()4.2|1 . and the message is further classified by assigning the subclass- (j, s) to 
it. Then messages from source-j and are stamped with the subclass- (j, s) are put into the 
subclass queue-(j, s). For subclass-(j, s), let FiAjg denote the mean number of messages of the 



subclass-(j, s) that arrive to the system in a time-slot; obviously X]{se5K-Sj>o} ^^js = E^j- 
A consequence of class sub-classification is that messages of subclass-(j, s) will be required 
to transmit codewords of length N{s), i.e., service requirement gets fixed. The state of the 
system is defined by the residual service requirements of messages of each subclass present in 
the system. Thus the definition of the system state a in the present context is essentially the 
same as defined in expression ()2.1|) of Chapter |2l except that the state includes a message's 
residual service requirement after sub-classification is done. We should observe here that 
njs{a) = if the pair (j, s) does not define a subclass. 

We now define the notion of a schedule on the set of message subclasses. We define 
a subclass schedule by a non-negative integer vector z = {zjs : 1 < j < J; s G 5k) such that 
< Zjs < Sj. We define the set = j-z : < J2j=i J2{seSK} — ^} ^'^ 
subclass schedules that schedule at most K messages in each time-slot. We say that schedule z 
is feasible in state a if zjs < njs{a) for all subclasses-(j, s). We implement a feasible schedule 
z by serving the first zjg messages at the head of the subclass queue-(j, s). We define the 
ongoing transmission of the schedule s G 5k in state a as the schedule ri{a,s) G ^Kj and 
//(a, s) is defined as follows: for 1 < j < J and t G 5k, 

. X J Er=i"^ I{^j,{k)<N{s)} if t = s and Sj > 
I otherwise 

We say that a message is fresh if the message has not yet been scheduled for the first 
time, i.e., the first code letter of the corresponding codeword is yet to be transmitted. The 
number of fresh messages of subclass-(j, s) in state a is denoted by Pjs{a), and is given by 

We constrain the operation of the system by requiring that there can be at most 
one ongoing transmission for any schedule s G 5k in any state a. Since first-in-first-out 
service discipline is used to schedule messages in each subclass queue-(j, s), we can determine 
whether there is an ongoing transmission of the schedule s in state a by examining the 
residual service requirement of the messages at the head of the subclass queues- (j, s). If 
there is one ongoing, then for at least one subclass-(j, s) , we have 1 < Xjs{l) < N{s) — 1. 



Formally, a policy in this class is defined by (i) an arbitrary probability distribution 
{p'^(s); s e »Sk}, and (ii) the mapping {lu : X ^ -2k}. We follow the convention that specifi- 
cation of the policy cu and of the probability distribution {p'^(s); s e 5k} are equivalent. We 
now define the notion of maximal schedule z*{a, s) in the set of the schedule s in state 
a. 



Definition 4.3.1 (Sub-Schedule) For z, z' e -Ek, we write z' ^ z if z'^^ < Zjs for each 
subclass-{j, s). We then say that z' is a sub-schedule of the schedule z. The maximal schedule 
z*{a, s) e 2^K of the schedule s in state a is defined as follows: for I < j < J and t e S^, 



z*t{a, s) 



min {sj , rijs («) } ift = s 
otherwise 



To implement a state- independent policy oo, a schedule s e 5k is chosen independent of the 
state a in each time-slot with probabihty p'^(s). Then the subclass schedule 



fj{a, s), if r]{a, s) is a non-empty schedule 
z*{a,s), otherwise 



is implemented in state a. For the given probability distribution {p'^(s); s e »Sk}, the map- 
ping {a; : A" — > 2^k} induces the probability distribution {p'^{z);z e Zk}, which is defined 

by 



p'^(s) if z = ri{a, s) where ri{a, s) is a non-empty schedule, 

or ^ = ^*(q!, s) and r]{a,s) is the empty schedule 
otherwise 



Lemma 4.3.1 Let K > 1, J > 1 and u) G Vt^ . For a E X and for each subclass-{j, s), 



define /i^^(a) = A^(s)/3js(a) + SjXjsil)I{n,,(a)>pjAa)}, c{a) = 1 + T.js^'jsi'^)' ^(") 



E 



js 2{p'^{s)sj-N{s)EAjs) 



Then the Markov chain is c-regular and stable ifEAjgNls) < p'^{s)sj 



for each subclass-{j, s) . ■ 

Proof: For each subclass-(j, s), define [Ti-js, 'Hjs} be a partition of X such that Hj^ = 
{a E X : ri{a, s) is a non-zero schedule, or > sj}. Let ajg subclass-(j, s) messages get 

generated in state a and that the feasible schedule z G 2k is implemented in the state a. 
Assuming that the chain moves to state a', we have 

^js ("') = + fjs{a) - 9jsia, z), where 

fjs{a) = ajsN{s) and gjs{a,z)=Zjs 



But, 



if a is the zero state, or a G Hj^, z 7^ //(a, s), 
and 2; 7^ z*(a;, s) 

if a G Tij^, and either z = ri{a, s) or z = z*{a, s) 
Sj)N{s) + Sj if a G Hjs and a is a non-zero state 



Now consider a G Hj^. Then gjs{o:) = Ezg^^ = ^jP'^i^)- Also, E/j^ 

N{s)EAjs. 



Assuming N{s)'EAjs < p'^{s)sj for each subclass- (j, s), and then applying Lemma E.3.21 
to c(a) and V{a) as defined in the statement of Lemma we find that the queueing 

model ri > 0} is c-regular. Since there can be at most one ongoing transmission of any 
schedule s in any state a, we have njs{a) < Pjsicn) + Sj. By observing that Xjs{k) > 1 and 
A^(s) > 1, we have 



Pjs{ci) + Sj otherwise 



^I{A} denotes the indicator function of the event A. I{a} — 1 if A is true, and if A is false 



Since h'jg{a) > njs{a) for every a, existence of finite stationary mean for c{a) implies exis- 
tence of finite stationary mean for n{a). Hence the queueing model is stable. ■ 



Let /ij = {fijs] s G 5k and sj > 0) be a splitting probability vector defined by 

s'G5k:s'>0} N{s') 



with the interpretation that is the probability that a class-j message request is assigned 
the schedule s. 

Lemma 4.3.2 For K > 1 and J > 1, the Markov chain is unstable if N{s)WiAjs > p'^{s)sj 
for at least one subclass-{j, s). ■ 

Proof: For the subclass- (j, s), define h'jg{a) = Ylk=i°'^ Xjs{k). Then, we have 

h'^j, {a') = /i^^(a) + fjs{a) - gjs{a, z), where 

/js(a) = ajsN{s) and gjs{a,z) = Zjg. Consider the partition \^Hjs,'Hjg} of the state space 
X defined by = {a E X : njs{a) > 0}. We now consider a G Hj^. Since zjg < Sj, 
we have gjsia) = Y.{zez^} 9jsio;, z)p'^{z) < Sjp'^is). Also, Efjs = N{s)EAjs. By applying 
Lemma EZSl to V{a) = 1 - 9^'^^^''^ < 6 < 1, we find that for N{s)EAjs > p'^{s)sj the 
Markov chain is unstable. ■ 

Prom Lemma [4.3.11 and Lemma f4.H.2^ we can easily see that 



7^" 



I EA : EAj < p'^(s)rj(s) for 1 < j < J I 
I se5K J 



and that the threshold on EAj is a convex combination of the set of rates {rj{s);s G iSk}. 
Define 7^ {Q^) = [J^^^k 7^'^. Then 7^ (fi^) is the interior of the convex hull of the rate 
vectors {r(s); s G Sk}- We denote the interior of the set A by A°. 

Corollary 4.3.1 TZ {Q^) = 7^°„i. For any given message arrival rate vector EA G T^ouf 



there exists a state-independent scheduling policy {p'^(s); s G 5k} such that the queueing 
model is stable. ■ 



The significance of tliis Corollary is that, if the queueing model is stable for the message 
arrival processes {Aj; 1 < j < J} and an arbitrary stationary scheduling policy, then there 
exists a state-independent scheduling policy u E such that the queueing model is stable 
for the same message arrival processes {Aj; 1 < j < J}- 

Proof: Suppose that, for some stationary scheduling policy, the queueing model 
{Xn, n> 0} is stable for the message arrival processes {Aj; 1 < j < J}. Let {7rK(s) : s G Sk} 
be the induced stationary probability distribution on the set of schedules iSk- Let 7rK(0) > 
be the stationary probability that no schedule is served in a time-slot. Since the queueing 
model is stable, the stationary mean residual service for subclass-(j, s) is finite, and hence 
EAjsN{s) = Ms)sj. 

Let us define a state-independent scheduling policy {p'^{s);s G iSk} as follows. For 
non-empty schedule s G Sk, define p'^{s) = 7rK(s) + where e<j > and J2s^s = ttk{0). 
Then, for each subclass-(j, s), WiAjsN{s) < p'^{s)sj. That is, for the message arrival processes 
{Aj, I < j < J}, the state-independent policy u makes the queueing model stable. ■ 

4.4 Information-Theoretic Interpretation to the Sta- 
bility Region 

For a fixed state-independent schedule s G iSk, i.e., p'^(s) = 1, we know from Lemma 14.3.11 
and Lemma r4.3.2l that the queueing model is stable if EAj < Rj{s) for 1 < j < J and sj > 0, 
and unstable if EAj > Rj{s) for at least one queue j such that sj > 0. We remind the reader 
that Rj{s) = 

In this section, we give the information-theoretic interpretation to the stability re- 
gion of nat arrival rate vectors WiA for the scenario (SI). A formal statement of this in- 
terpretation is made in Theorem 14.4.11 For s G iSk, define the code rate vector R{s) = 



{Ri{s), R2{s), . . . , Rj{s)). In Theorem 14.4. H we show the following: (i) for a given joint 
probability distributions Q, and message arrival processes {Aj] 1 < j < J} such that = 
r G I°{Q), we determine a schedule s, message alphabet size vector M, and a value for 
the parameter p such that the message communication system for s, M, p, and the arrival 
processes {Aj; 1 < j < J} , is stable (i.e., Rj{s) > rj, 1 < j < J); (ii) for any s, M, and p, 
we show that R{s) G I"{Q). Define 7^(Q) = {R{s) : < p < 1; K > 1; s G 5k; M e Z^} to 
be the set of all possible code rate vectors R{s). 

Theorem 4.4.1 (Information-Theoretic Interpretation) 



Proof: We first show that I°{Q) C TZ{Q). Choose an r G I°{Q). Then there exists 
an e > such that r + e = (ri + e, r2 + e, . . . , rj + e) G T°{Q). For 1 < j < J and a 
positive real number A, let us first choose Sj and Mj as real numbers such that the product 
Sj InMj = A(rj + e). From Lemma f4.1.H 



7^(g) 




Sfc(lnMfc)Eo,5(p, Q) 



< Rk{s) 



Eo,s(p,Q) 



< 



min -p 



Sfc(lnAffc)Eo,5(p,Q) 



Eo,s{p,Q) 



We can see that 



lim lim Rk(s] 

p^OA^oo 



lim lim min 

p^OA^oo S€V{J) 



lim lim min 

p^OA^oo sev{j) 



A(r,, + e)Eo,5(p, Q) 



A{rk + e)Eo,sip,Q) 



Eo,s{p,Q) 



{rk + e)Eo^s{p,Q) 



Eo.s{p,Q) 



= lim min -. r — 

= mm (rfc + e) — — 

(b) 

> rk + e, 



where (a) follows from Part (i) of Lemma IB.0.2[ and (6) follows from the fact that r + e G 
X°(g) and hence 'Ejesi'^j + e) < I {X{S);Y\X{S'')). Denote by lim^^o limA^oo = 
R*{s). 

Choose two positive real numbers 6k and 5^ such that 6—5^—5^ > 0. Then there exists 
a p {6k) < 1 such that for all < p < p {6k), we have hmA^oo -Rfc(s) > R*{s) —6k > r^ + e — 5^. 
Now, for a fixed value pk for p such that pk < p {6k), there exists a A {pk, 6'^) such that for 
all A > A {pk, 6'f,), we have Rk{s) > limA^oo Rk{s) — 6[ > Vk + e — 6k — 6[ > Vk- Choose an 
Ak for A such that A^ > Ak {pk, 6k). Define A* = max^ A^ and p* = min^ p^. 



Since Sj and Mj for 1 < j < J have to be positive integers, one can, for a given A* 



choose 



In A/, 



for a given Mj, and Mj 



exp 



A*(rj+€) 



for a given Sj, and still 



have the same limit as above. 



Next, we prove 71{Q) C T°{Q) by showing that R{s) for each triplet s, p, and M 
satisfies all the 2"^ — 1 constraints that define the set X°{Q). From Lemma f4.1.H we have for 



any S G V{J) that 



ERk(s) < > min 
fce5 kes 



Sk{lnMk)Eo^s'{p,Q) 



< 



Sk{lnMk)Eo^s{p,Q) 



kes [- Inpe + P Ejg5 ■^j In Mj 
Sk{lnMk)Eo,s{p,Q) 



Eo,sip,Q) 



EoAp^ Q) 



< I{X{S);Y\X{S')) 



where (c) follows from Part (ii) of Lemma fB.0.21 Thus. R{s) E T°{Q) for each s, p, and M. 



Chapter 5 



Communication Over Degraded 
Broadcast Channels 

The primary intention in this chapter is to demonstrate that the queueing-theoretic model 
derived for scheduled multiaccess message communication with joint maximum-likelihood 
decoding in ChapterlUcan be used to model scheduled message communication over degraded 
broadcast channels with random message arrivals. Due to similarity in the queueing model, 
we skip queueing model analysis details wherever and whenever possible. 

5.1 The Information- Theoretic Model 

A broadcast channel is one through which one source communicates its information to two 
or more receivers. Formally, a discrete-time stationary memoryless broadcast channel with 
J receivers is defined by a finite input alphabet X and finite output alphabets 3^j, 1 < j < J, 
and a transition probability law {p{yi,y2, ■ ■ ■ ,yj\x);x G X and yj G 3^j}. An assumption 
inherent in this definition is "no-collaboration" among the J receivers. This assumption then 
allows us to view a broadcast channel as a collection of J single-user channels with marginal 
transition probabilities piyi\x) , p{y2\x) , . . . ,p{yj\x). 

For 1 < j < J and integers Mj > 2, let A4j = {1,2, . . . ,Mj} denote the message 
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alphabet of the jth source, and define Xj to be a finite set of symbols. For 1 < j < J, 
define the random variables Xj and Yj that take values in the sets Xj and y^, respec- 
tively. Let the jth source output be modeled by the random variable rrij that takes val- 
ues in the set Aij. Some notation specific to this chapter is introduced now. Let a and 
b be any two positive integers such that 1 < a < b < J. We define the Cartesian 
products = A4a X -M-a+i X • ■ ■ X A4b, and similarly A"^ and y^. Then the vectors 
= {ma,ma+i, . . . ,mb) G A^^, and similarly G Xj^. Define Qj = {Qj{xj)]Xj G Xj} 
to be an arbitrary probability assignment on Xj. For 1 < j < J — 1, define Qj (xj+i) = 
{Qj {xj\xj^i) ; Xj G Xj} to be an arbitrary probability assignment on Xj for each Xj+i G Xj^i 
. Define Qj = [xj) = Qj (xj) Y[i=l Qi ! ^j ^ '^/j to be the product distribu- 

tion on Xj' . 

A broadcast channel {p{yi,y2, ■ ■ ■ ,yj\xi); Xi G Xi and yj G yj} is said to be degraded 
if Xi ^ Yi ^ I2 ^ ■ ■ ■ ^ is a Markov chain, i.e., for 2 < j < J, there exist probability 



distributions pj{yj\yj-i) such that piyj\xi) = Y.y{-^ {piyi\^i)Ili=2Piiyj\yj- 



Fig. O 



shows a degraded broadcast channel through which J sources communicate information to 
the respective receivers. We note that with superposition encoding Xj, . . . , Xi, Yi, . . . ,Yj is 
a Markov chain, and for 2 < j < J, the jth channel is a degraded version of the (j — l)th 
channel. 
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Figure 5.1: Model of Degraded Broadcast Channel 



Formally, for an integer > 1, the superposition encoder is defined by the mapping 
I f ^ X^^'^ I , and the decoder at the jth receiver is defined by the mapping 
The capacity region for general degraded broadcast channels, first conjectured in Cover 3 



was established by Bergmans \Xi- The converse was estabhshed by Bergmans ^ and Gal- 
lager [H]. 



Theorem 5.1.1 ([Ij) Consider a degraded broadcast channel consisting of J component 
channels (receivers) and represented as the Markov chain 



X, 



X 



j-i 



Xo 



j-i 



Yj. 



For a given joint probability distribution 



Q{x() 



Qjixj)Qj-i{xj-i\xj) ■ ■ ■Qiixi\x2)piyiy2 ■ --yjlxi), 



define I{Q) to be the set of rate vectors r = (ri, r2, 



,0 e 



satisfying Tj < I{Xj;Yj\Xjjf^i] 



for 1 < j < J — 1, and rj < I{Xj; Yj). The capacity region C is then defined as the convex 
hull of[jQl{Q). ■ 

Let X^^} G A",-^-* denote the codeword chosen for the message vector mi . Then, for 
1 < / < A^, let x^jij) denote the /th letter of the codeword. The ensemble of broadcast 
codes we consider here is the same as Bergmans P constructed. The random code ensemble 
is generated in J stages as follows. First, consider the ensemble of Mj code words jx^''! 
in which each of the N letters in each of the Mj code words is independently selected 
according to the probability assignment Qj. For each of these code words, we choose Mj_i 
code words with independent letters from the set according the assignment Qj-i- That 
is, conditional on X^j = 1 < I < being the mjth code word, 1 < nij < Mj, 

the probability of a code word = (x^j~i{l); I < I < n) , mj^^ = (mj_i,mj), mj_i e 

Aij-i and rrij G A^j, is 



X 



(N) 



N 



no 

1=1 



j-i 



(/) 



Continuing this way, we would have, at the beginning of the jth stage, generated ■ ■ ■ 

codewords. At the end of the Jth stage, M1M2 ■ ■ ■ Mj code words will be generated. During 
the jth stage, the process of codeword generation can be modeled by an artificial DMC 



with transition probability Qj{xj\xj+i). Each of the A^-length Mj+iMj+2 ■ ■ ■ Mj codewords 
generated so far are passed through the artificial channel Mj times, thus generating a total 
of MjMj^i ■ ■ ■ Mj codewords. 

A random coding upper bound on message decoding error probabilities for the two 
receiver degraded broadcast channel was derived in jB]. Here we extend that result to a 
degraded broadcast channel with arbitrary number of receivers. The objective of the decoder 
at the jth receiver is to compute an estimate rhjj ^ of rrij. This is achieved by successive 
decoding, with the jth decoder first decoding and then subtracting the signals intended for 
the users with noisier channels before decoding its own. Let the event {rhkj 7^ mi^} be the 
event that the decoder at the jth receiver makes an error in decoding the kth source. The 
probability of error for the jth decoder then is p {{'rhjj 7^ ^j})- 

For 1 < j < J and j < k < J, let Pe,k,j denote the probability of decoding the 
kth source at the jth receiver incorrectly conditioned on + 1, + 2, . . . , Jth sources being 
decoded correctly, and Pe,k,j the expectation of Pe,k,j over the ensemble of broadcast codes. 
The transition probability of the effective channel between X^, 1 < k < J, and Yj, 1 < j < J, 
for Xk G Xk and yj G yj, is given by 

Py,|x,(l/ikfc) = Yl I n ) ^'^^il^iM '^^'l^'-i) ) 

a-fe-i j^J-i \t=k~l J \l=2 J 

One can then consider yj as being produced by passing x^ through a DMC with transition 
probability law Py ix {Vjl^k)- In the following Theorem 15.1.21 we compute an upper bound 
on the expected probability of the event {rhjj 7^ ^j}- 

Theorem 5.1.2 For 1 < j < J, (i) 7^ ^j}) ^ ^k=jPe,k,j CLnd, (ii) for < p < 1, 

the expected probability Pe^k,j\m given that the joint message m is encoded is upper bounded 

^ Since, for j < k < J, kth source message is estimated at the jth receiver, we denote an estimate of the 
fcth source at the jth receiver by rhkj G -^j- 



as 



Pe,k,j\m < exp (-A^Ex,,K,.(i?fc)) 
Exk,Yj{.Rk) = Eo,Xk,Y,{.P) - pRk 

Rk 



N 



^k+l 



(5.1) 

1+p 



for j < k < J — 1, and 

Eo,Xj,YjiP) 



5Z ( 5Z i^j) Py,\Xj iVjlxj) J 



1+p 



for k = J 



Proof: To prove Part (i), consider the joint ensemble formed by the random vectors 
(mj J-, mj+ij, . . . , rhjj) and (mj, mj+i, . . . , mj). Define the event Ej as the set of all sample 
points in this joint ensemble such that rhj^j ^ mj. We now show that Ej can be expressed 
as a union of J — j + 1 mutually exclusive and collectively exhaustive events. For j < I < J, 
define the events Ej{l) as follows: Ej{j) = {rhj j ^ rrij] rhkj = rrik for j + 1 < k < J}, and for 
j + 1 < I < J — 1, Ej{l) = {rhjj 7^ nij] rhij ^ nii; ihkj = nik for / + 1 < A; < J}, and finally 
Ej{J) = 7^ ^j'-i^Jj 7^ f^j}- Then Ej = [jf^-Ej{l). But, for j < / < J — 1, we have 

that Ej{r) C {fhi^j 7^ m;; m^j = for / + 1 < /c < J}, and for / = J, Ej{J) C {tTLjj ^ mj}. 
Hence, for j < / < J — 1, we have 

p {Ej{l)) < p {{rhij 7^ mi; rhkj = for / + 1 < A; < J}) 
< p {{iTii j 7^ mi\7hkj = ruk for I + 1 < k < J}) 

= Pe,l,j, 

and for I = J, p {Ej{J)) < p {{rhjj ^ mj}) = pe,jj- Hence p {{rhjj ^ mj)) < Y.i=jPe,k,j- 

Next we prove Part (ii). Proof of Part (ii) is a straightforward extension of the proof 
given in To derive an upper bound on Pe,A;,j|m! we first condition the event of this type 



of error upon the code word chosen for the message vector m{_^_^. Let Pe,k,j [X^j ) 

be the probabihty of this error event. That is, Pe k j i X^^J ) is the probabihty that 



rn'l) - Pyj\Xk 



X 



(N) 



for some m'^ such that m'^+i = TT^-i+i ^i^nd mj, 7^ in the conditional ensemble, and X 



is independently chosen with the probability assignment Qk (X 
Theorem 5.6.1 [5^ applies to this situation, yielding 



-(TV) 



(N) 

4 



X*-^-* ) . The coding 



N 

n=l yj \ Xk 

Next, Pe^k,j\m is the expected value of Pe,k,j [X^t ) over m'l_^_i and X^j . Since the bound 
is independent of we average only over X^ 



-(TV) 
''fc-t-i 



Pe,kJ\m - ^Pe,k,j (^IJj^J Qk+1 



1+p 



k{xk\xk+i)p'Y^\xSyj\xk)^+p 



TV 



For k = J, Pe,j,j\m is the expected probability of error in decoding source-J when it is com- 
municated over a discrete memoryless channel with transition probability law p'y [XjiVjl^j) 
and channel input distribution Qj. Thus, the probability of decoding error is bounded above 
by the usual results for decoding on a DMC (Theorem 5.6.1 ■ 



5.2 The Queuing-Theoretic Model 

The queuing-theoretic model for a J receiver degraded broadcast channel that we derive is 
similar to the queuing-theoretic model we derived for the J source multiaccess channel with 
joint maximum-likelihood decoding for the scenario (SI) in Chapter ^ The similarity can 
be seen as follows: we maintained a queue for each source in the case of the multiaccess 



channel, whereas we maintain a queue for each receiver at the transmitter in the case of 
the degraded broadcast channeL Hence, messages that arrive at the transmitter and are 
intended for receiver-j are put into queue j. For K > 1, let iSk (as defined in Chapter 12)) be 
the set of schedules that encode at most K messages for transmission. 

Under the scenario (S3), a schedule s G iSk defines product message alphabets 
M.j{s) = {l, 2, . . . , MJ^} such that sj ^ for each of the J receivers. Hence we need 
to redefine the coding rate Rk (Eq. in Theorem 15. 1.2j) for receiver-fc as Rk{s) = ^^^^jjj^, 
thus emphasizing the dependence of effective message alphabet size on schedule s. Let 
Xj {s, Nj{s)) denote the random coding upper bound ^^^^exp (^—Nj{s)Exf.Xj{Rk{s))) for 
the jth receiver under the schedule s, and {pej', ^ ^ j J} the set of tolerable message 
decoding error probabilities. For 1 < j < J and s E Sk such that sj > 0, define Nj{s) to be 
the smallest positive integer such that Xji^^ < Pej- In the following Lemma 15. 2. ![ we 

derive an upper bound and a lower bound on Nj{s). 

Lemma 5.2.1 

max < JMAs) < max 



j<k<J Eo^Xk.Yj ' j<k<J Eo^Xk,Yj 



Proof: The arguments leading to the above bounding are similar to the arguments 
given in the proof of Lemma 14.1.11 Hence we skip the detailed proof. ■ 

Lemma 5.2.2 Let s' < s. Then Nj {s') < Nj{s) for 1 <j < J. ■ 

Proof: Since s'^ < Sk, we first note that Rk{s'i^) < Rk{sk). Since, Eo,Xk,Yjip) 
independent of and Sk, we conclude that Ex^Xj {Rk (s^)) > Ex^y^ {Rk{sk)). Now, we 
observe that 

J J 
Pej > Y^exp {-N,{s)Ex,,Y, (Rkisk))) > J^exp {-N^{s)Ex„y, {Rk{s'k))) 

k=j k=j 



Thus, Xj {s', Nj{s)) < pej. Since Nj{s') is the smallest positive integer such that 

Xj (s', Nj (s')) < Pej, we have that Nj {s') < Nj{s). ■ 

Define N{s) = maxj Nj{s). Then N{s) is the smallest positive integer such that Xj {s, N{s)) < 
Pej for I < j < J. 

At this point we should observe that, at the beginning of each time-slot, we need to 
inform the receivers about the schedule s that will be implemented in that time-slot. This is 
achieved by assuming that synchronized common randomness is available at the transmitter 
and receivers to generate schedules with the distribution p'^ (and also the code books). Then, 
only those receivers-j such that Sj > will decode their respective received signals. But, 
in a particular time-slot, it may happen that a schedule s is chosen for transmission and 
enough messages of each class required by the schedule s are not present in the system. To 
resolve this problem, we can substitute each such "missing message" by a message with null 
value, thus embedding control information in information from sources. Inclusion of the null 
message in Aij increases the cardinality Mj by one and may have the effect of increasing 
N{s) accordingly, thus reducing the throughputs achievable for finite message lengths. But 
this effect disappears in the asymptotic limit Mj — * oo. 

However, in the following we assume that this control information is passed to the 
receivers over an error-free control channel, so that the queueing model analysis presented 
in Chapter E] applies in the present context without modifications. 

Define the service requirement N{s) of a message under schedule s, and the service 
quantum available to queue j at a discrete-time instant, as in Chapter 0] Then (i) the 
notion of rate vectors {r(s);s G 5k} and the outer bound TZout derived in Section on 
the stability region of message arrival rate vectors WiA achievable by stationary scheduling 
policies, and (ii) the definition of state-independent scheduling policies and their stability 
analysis described in Section [4.31 and the following Corollarv 14.3.11 therein, apply verbatim 
to the queueing model for the degraded broadcast channel. 



5.3 Information-Theoretic Interpretation to the Sta- 
bility Region 



For a fixed state-independent schedule s G iSk, i.e., p'^{s) = 1, we know from Theorem I4.H.1I 
and Theorem I4.H.2I that the queueing model is stable if EAj < Rj{s) for I < j < J, and 
unstable if EAj > Rj{s) for at least one queue j. 

In this section, we give the information-theoretic interpretation to the stability re- 
gion of nat arrival rate vectors WiA for the scenario (S3). A formal statement of this in- 
terpretation is made in Theorem 15.3.11 For s G iSk, define the code rate vector R{s) = 
(-Ri(s), i?2(s), . . . , -Rj(s)). In Theorem 15.3. we show the following: (i) for a given joint 
probability distributions Q, and message arrival processes {Aj; 1 < j < J} such that WiA = 
r G 2°{Q), we determine a schedule s, message alphabet size vector M, and a value for 
the parameter p such that the message communication system for s, M, p, and the arrival 
processes {Aj; I < j < J} , is stable (i.e., Rj{s) > rj, 1 < j < J); (ii) for any s, M, and p, 
we show that R{s) G I°{Q). Define 7^(Q) = {R{s) : < p < 1; K > 1; s G 5k; M G Z^} to 
be the set of all possible code rate vectors R{s). 

Theorem 5.3.1 (Information-Theoretic Interpretation) 

7^(Q) = j°(g) 



Proof: We first show that I°{Q) C TZ{Q). Choose an r G I°{Q). Then there exists 
an e > such that r + e = (ri + e, r2 + e, . . . , rj + e) G X°{Q). For 1 < j < J and a 
positive real number A, let us first choose Sj and Mj as real numbers such that the product 



Sj In Mj = A{rj + e). From Lemma f5.2.H 



mm mm 

l<j<J j<k<J 



s,{\nMi)E,^x„Y, 



In 



We can see that 



lim lim Ri{s) 

P^O A—^oo 



< RAs) 



< min min 



Si(lnMO^o,x„y, 



^<3<Jj<k<J \— Inpej + pSk In Mk] 



lim lim min min 



A(r, 



)E. 



o,Xk,Yj 



A^ooi<j< J j<k< J [— Inpej + pA{rk + e)]^ 

A(r, + e)Eo,x„Y, 



lim lim min min 

p-*0 A^oo l<i< J j<k<J 



lim min min 



n + e Eo,Xk,Yj 



p^oi<j<J j<k<J rk + e p 
(a) . .n + e 



mm mm 



i<j<Jj<k<J Vk + e 



I [Xk] ^j\Xk+l] 



W . ^ . . . I {Xk-,Y^\Xk+,] 
> (ri + e) mm mm 



i<j<Jj<k<J I (Xfc; Yk\Xk+i] 



(c) 

> ri + e, 



where (a) follows from Part (i) of Lemma fB.0.3| (6) follows from the fact that r + e G T°{Q) 
and hence + e < / (X^; Y^lXfe+i), and (c) follows from the data processing inequality 
(Theorem 2.8.1 in applied to the Markov chain Xj ^ ■ ■ ■ Xi ^ Yi - ■ ■ ^ Yj. Denote by 
limp^olimA^ooi?fc(s) = R*{s). 

Choose two positive real numbers 5i and 5[ such that e — 5i — 5[ > 0. Then there exists 
a p < 1 such that for all < p < p we have limA^oo Ri{s) > R*{s) — 5j > rj + e — 5j. 
Now, for a fixed value pi for p such that Pi < p there exists a A (p^, 5^) such that for all 
A > A (pi, we have -Ri(s) > limA^oo Ri{,s) — 5[ > Vi + e — 5i — 5[ > r^. Choose an Aj for A 
such that Aj > Aj (p^, 5^'). Define A* = maxj Aj and p* = miuj pj. 



Since and Mj for 1 < j < J have to be positive integers, one can, for a given A* 



choose Sj 



A*(^i+^) 
In Mi 



for a given Mj, and Mj- 



exp 



A*(r-j+€) 



for a given Sj, and still 



have the same hmit as above. 



Next, we prove Tl{Q) C T°{Q) by showing that R{s) G T"{Q) for each s, p, and M. 
From Lemma [5.2.11 

Hi[s) < mm mm 



l<3<J3<k<J \- Inpei + pSfc In Mfc] 

. Si(lnMi)Eo,x,,K,^o,x„y, 

< mm ; < — ■ — — 

i<j<J pSjliiMj p 

W f / (X,; Yi\Xi+i) for l<i<J-l 

I{Xj;Yj) for t = J 

where (d) follows from Part (ii) of Lemma fB. 0.31 Thus, R{s) G T°{Q) for each s, p, and M. 



Chapter 6 



Conclusion 



We have developed a unified framework, namely, multiclass discrete-time processor-sharing 
queueing model of Chapter |2l to analyze stability of scheduled message communication over 
multiaccess channels with either independent decoding or joint decoding, and over degraded 
broadcast channels. Under this framework, we modeled both the random message arrivals 
and the subsequent reliable communication by suitably combining techniques from queueing 
theory and information theory. 

For scheduled message communication over a multiaccess channel with independent 
maximum-likelihood decoding, we showed the following. 

1. For finite message lengths, inner bounds and outer bounds to the message arrival 
rate stability region are derived. For arrival rates within the inner bounds, we show 
finiteness of the stationary mean for the number of messages in the system and hence for 
message delay. For the case of equal received signal powers, with sufficiently large SNR, 
the stability threshold increases with decreasing maximum number of simultaneous 
transmissions (see Fig. I3.2|l . 

2. When message lengths are large, the information arrival rate stability region has an 
interpretation in terms of interference-limited information-theoretic capacities. For 
the case of equal received powers, this stability threshold is the interference-limited 
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information-theoretic capacity. 

3. We propose a class of stationary policies called state-independent scheduling policies, 
and then show that they achieve this asymptotic information arrival rate stability 
region. 

4. In the asymptotic limit corresponding to immediate access, the stability region for 
Gaussian encoding and non-idling scheduling policies is shown to be identical irrespec- 
tive of received signal powers. This observation essentially shows that transmit power 
control is not needed. We show that, in the asymptotic limit corresponding to imme- 
diate access and large message lengths, a spectral efficiency of 1 nat/s/Hz is achievable 
with non-idling scheduling policies (see Fig l3.3j) . 

For scheduled message communication over multiaccess channels with joint maximum- 
likelihood decoding, we derived an outer bound to the stability region of message arrival rate 
vectors achievable by the class of stationary scheduling policies. Then we showed for any 
message arrival rate vector that satisfies the outer bound, that there exists a stationary 
"state-independent" policy that results in a stable system for the corresponding message 
arrival processes. Finally, we showed that for any achievable rate vector in the capacity 
region of a multiaccess channel, there exists a scheduling strategy and message lengths for 
that rate vector such that the message system with random message arrivals is stable. 

We showed that the queueing model derived in the case of multiaccess channels with 
joint maximum-likelihood decoding can be used to model scheduled message communication 
over degraded broadcast channels with superposition encoding and successive decoding. We 
then showed that the results obtained from stability analysis of multiaccess channels apply 
verbatim to the degraded broadcast channels. We also showed that for any achievable rate 
vector in the capacity region of a degraded broadcast channel , there exists a scheduling 
strategy and message lengths for that rate vector such that the broadcast message system 
with random message arrivals is stable. 



Appendix A 



Drift theorems for Positive 
Recurrence and Transience 

Drift theorems for classification (in terms of transience, positive recurrence and null recur- 
rence) of discrete-time Markov chains taking values in a general state space have been stated 
in JI]. We rewrite the theorems here for discrete-time Markov chains taking values in a 
countable state space. 

[TT] defines a measure, ^, on the state space, X, which is called the 'maximal 
irreducibility measure'. For an irreducible Markov chain taking values in a countable state 
space, the measure ip is generated by a counting measure on X [p. 88, [Hj]. Hence, an 
irreducible Markov chain taking values in a countable state space, X, is ^/'-irreducible with 
ip{o.) = 1 Va G X, where a denotes a state in the countable state space. 

[TT] defines the set, -B(X), [p. 55, llj as some a-algebra on the general state space, 
X. For a countable state space, without loss of generality, we take this a-algebra as the set 
of all subsets of X. Then, 5+(X) defined as 5+(X) = {A e B{X) : %1){A) > 0}, in the case 
of irreducible Markov chains on a countable state space, becomes the set of all non-empty 
subsets of X, i.e., B+{X) = B{X) - 0. 

We now rewrite the theorems stated in JT] for discrete-time Markov chains taking 
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values in a countable state space. 



A.l Theorem for Positive Recurrence 

Theorem 11.3.4 stated in [TT] can be written as follows. Suppose C G B{X) and C is petite, 

and an everywhere finite function V : X [Q, oo) satisfies 

^V{xY ^ + i> ^c{x)i X & X, b < oo, then $ is positive Harris recurrent. 

Finite sets in a countable state space are petite [p. 192, ^llj. A chain $ is Harris 
recurrent if every set in B{X) is Harris recurrent [p. 200, jHj]. If a set is Harris recurrent then 
it is recurrent [p. 201, ^I]]. Positivity for a ^/'-irreducible Markov chain means existence of 
an invariant probability measure for the chain [p. 230, ^HJ]. Thus, for an irreducible Markov 
chain on a countable state space positive Harris recurrence implies positive recurrence. The 
theorem stated above, together with the interpretations made before, can then be written in 
the context of Markov chains in a countable state space as follows. 

An irreducible Markov chain, $, is positive recurrent if there exists a finite subset C 
of X and an everywhere finite function : X [0, oo) bounded on C such that 

a. AV{x) <-l,xe C, and 

b. AV{x) < -1 + 6, 6 < oo, for a; G C. 

A. 2 Theorem for Transience 

Theorem 8.0.2 (i) stated in llj is as follows : Suppose $ is a ^/'-irreducible chain. The chain, 
$, is transient iff there exists a bounded non- negative function, V, and a set C G B^{X) 
such that for all x G C^ AV{x) > 0, and D = {x : V{x) > snpy^c Viv)} ^ B+{X). 

Thus, the theorem stated above, together with the interpretations made before, can 
be written in the context of Markov chains in a countable state space as follows : 

^AV{x) is the expected drift of the function, V, in state x. 



An irreducible Markov chain, is transient iff there exists a bounded non-negative 
function, V, and a non-empty set C C X such that for all x e C"^, AV{x) > 0, and 3a; e C"^ 
such that V{x) > sup^g^y(y). 



Appendix B 



Two properties of E^^g^p^ Q) and 

In this appendix, we state two properties of Eo^s{p, Q) and Eo^x^Xj used in the random coding 
upper bounds on expected decoding error probabihties for joint maximum-hkehhood decod- 
ing for the muhiaccess channel (Chapter and the degraded broadcast channel (Chapter Ej), 
respectively. These properties are derived by a straightforward application of Theorem 5.6.3. 
in [Sj for the respective communication channels. 

For a finite set Z, define a random variable Z that takes values in the set Z with the 
probability distribution Qz = {Qzi^); z G Z^. Let X and Y be the input and output of a 
DMC, and for z ^ Z consider the input distributions Q\ = {Qx{x); x G X} and the transi- 
tion probability law {p^{y\x);x E X,y E y}. Then {p^{y)]y G 3^} is the probability distri- 
bution induced on the output alphabet 3^. Define g{p,z) = J2y [J2xQxi^)P^iy\^)^^'' ) ' 
and then Eo{p) = - ln^^Qz{z)g{p, z). 

Lemma B.0.1 lim^^o ^ = /(X;F|Z), and ^ is a decreasing function for p G (0, 1]. 

■ 

Proof: Define G{p) = exp (— i?o(p)) = J2zQz{^)g{Pj K is easy to observe that 
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g{0, z) = 0. We have 



dgjp, z) 
dp 



dg{p, z) 



dp 



p=0 



E 



+ 



1 i+p 



i + P 



y y X P \y\^) 

~H{Y\Z = z)+ H{Y\X, Z = z) 
-I{X;Y\Z = z), and 



lnp^(y|x) 



dG{p) 



dp 



p=0 



HQ 



dg{p,z) 



dp 



p=0 



- E Qz{z)IiX; Y\Z = z) = -I{X- Y\Z) 



Since ^^(O) = 0, and 



Define /(p) 



dG{p) 
dp 



Eo(p) 



dEo(p) 
dp 



exp (-^o(p)), we therefore have = /(X; F |Z) 



p=0 



for p G (0, 1]. Then 



dm 

dp 



dp 



■Eoip) 



. Now, define v{p) 



- Eoip) for p e [0, 1]. Then we can see that v{0) = 0, and ^ 



dp 



P 



d'^Eojp) 
dp^ 



< for 



p > (Theorem 5.6.3 in [SI). So we conclude that v{p) is a decreasing function in p, and 
since f (0) = we have that v{p) < for p G (0, 1]. Equivalently, < for p G (0, 1]. This 
estabhshes that /(p) is a decreasing function in p and that ^ < J(X; Y\Z) for p G (0, 1]. 



We now state the following two Lemmas. Lemma fB. 0.21 results when Lemma fB.O.ll is 
applied to E^^sip^Q) iii Theorem 14.1.21 Part (i) and (ii) of Lemma fB.0.31 result if we apply 
Lemma IB. 0.11 to Eo Xi. y in Theorem 15.1.21 



Lemma B.0.2 Consider a J source multiple- access channel with joint maximum-likelihood 



decoding. Then (i) lim^^o ^"'^^^'^^ = / Y\X {S^)) for S G V{J), and (ii) 

I{X{S)-Y\X{S^))forpe{QM 



Eo.s(p,Q) 



< 



Lemma B.0.3 Consider a J-receiver degraded broadcast channel represented as the Markov 



chain Xj Xj^i 



Xi ^ Yi 



Yo 



Yj. Then (i) lim^ 



p^O 



liXk, r,|Xfc+iXfc+2 ■■■Xj) = liXk, (zz) < /(x,- r,|x,+i) forp e (o, i]. 
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